Senior Software Engineer - AI Platform

The AI Platform owns Datadog’s entire AI stack—everything from distributed training infrastructure (for our SOTA models) to the frameworks that power Bits AI, LLMObs, and the next wave of generative‑AI experiences. We’re expanding beyond model creation to the tooling that lets engineers ship production‑grade GenAI systems: retrieval‑augmented pipelines, autonomous agents, and evaluation harnesses.

We’re looking for a Senior Engineer to design and build this next‑gen platform, partner with Applied AI, product, and core‑infra teams to deliver:

• 
  

  Large‑scale experimentation, training, deployment, and monitoring



• 
  

  Developer toolchains for agents and other GenAI applications



• 
  

  Low‑latency serving infrastructure that plugs AI features into any Datadog product

At Datadog, we place value in our office culture - the relationships that it builds, the creativity it brings to the table, and the collaboration of being together. We operate as a hybrid workplace to ensure our employees can create a work-life harmony that best fits them.

What You’ll Do:

• Lead the design, development, and deployment of scalable tools and infrastructure to support the efforts of our data scientists (model training & serving infra, CI/CD, orchestration, deployment,...)


• Create a development ecosystem that enables rapid experimentation and deployment of algorithms


• Stay on the cutting edge of development in the MLOps domain and document best practices to share across teams


• Drive the technical growth of Machine Learning as a distributed capability at Datadog, spanning all product areas, as well as leverage DD’s knowledge in observability to contribute back to the MLOps community

Who You Are:

• You have a BS/MS/PhD in a Computer Science, Engineering, Machine Learning or a related scientific field or equivalent experience


• You are a software engineer at heart with 5+ years of professional experience in building distributed systems, data science applications, and/or machine learning engineering


• You have proven ability to architect, build, and operate distributed systems to solve problems at a high scale


• You have extensive experience executing projects that span data engineering, data science, and machine learning


• You ship fast, route around blockers, and are comfortable working with ambiguity


• You’re happy to jump into any part of the stack and do whatever’s needed to move a project forward


• You have demonstrated ability to use AI coding tools in day-to-day workflows and validate, critique, and refine AI-generated output.


• Bonus: you’re motivated to push the boundaries of how AI can improve software engineering best practices and contribute to building AI-enabled products.

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.

Benefits and Growth:

• New hire stock equity (RSUs) and employee stock purchase plan (ESPP)


• Continuous professional development, product training, and career pathing


• Intradepartmental mentor and buddy program for in-house networking


• An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups)


• Access to Inclusion Talks, our internal panel discussions


• Free, global mental health benefits for employees and dependents age 6+


• Competitive global benefits

Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.