Senior LLM Engineer

We’re a new team building AI-assisted tools to make Datadog developers more effective, by autonomously generating tests, fixing bugs, and improving performance.

We’re looking for a product-minded generalist to help us quickly define and ship products that make all Datadog customers 10x developers.

At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

What You’ll Do:

• Work closely with our users, designers, PMs, and data scientists on cutting edge and delightful LLM-based agents.


• Work on prompts, evals, and agent tools for working with code, and on the engineering to productionize these systems and integrate them with Datadog products.


• Prototype and see what works well in the real world, iterate closely with our users, and then ship.


• Follow the latest research on LLM prompting, agents, and code editing.


• Work with other Datadog teams to expand capabilities, for example integrating with the Datadog IDE extensions to deliver a CoPilot-like assistant, or Dynamic Instrumentation to collect more runtime data from production and pre-production environments.

Who You Are:

• You’re a backend engineer with at least 5 years of professional experience (Go, Java, Python) who values code simplicity and performance. You’ve shipped software that uses LLMs to production.


• You are passionate about Generative AI and its ability to help software engineers be more productive.


• You have relevant experience with Large Language Models, large-scale systems and data sets, machine learning, or adjacent fields.


• You are a great community ambassador and can drive hard technical conversations towards a pragmatic solution.


• You want to work in a fast, high-growth startup environment that respects its engineers and customers.


• You have experience writing developer tools (such as IDEs, static code analysis tools, or compilers).


• You have demonstrated ability to use AI coding tools in day-to-day workflows and validate, critique, and refine AI-generated output.


• Bonus: you’re motivated to push the boundaries of how AI can improve software engineering best practices and contribute to building AI-enabled products.

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.

Benefits and Growth:

• New hire stock equity (RSUs) and employee stock purchase plan (ESPP)


• Continuous professional development, product training, and career pathing


• Intradepartmental mentor and buddy program for in-house networking


• An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups)


• Access to Inclusion Talks, our Internal panel discussions


• Free, global mental health benefits for employees and dependents age 6+


• Competitive global benefits

Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.