Skip to content
DatadogDatadogNew York, NY

Senior Software Engineer - AI Code Gen - Agent Engineer

Build AI-assisted tools using LLMs to generate tests, fix bugs, and boost developer productivity at Datadog. Requires 5+ years backend experience in Go/Java/Python and shipping LLM software to production.

187k – 240k
Hybrid5+ YOEML Engineering

About the role

What You’ll Do:

  • Work closely with our users, designers, PMs, and data scientists on cutting edge and delightful LLM-based agents.
  • Work on prompts, evals, and agent tools for working with code, and on the engineering to productionize these systems and integrate them with Datadog products.
  • Prototype and see what works well in the real world, iterate closely with our users, and then ship.
  • Follow the latest research on LLM prompting, agents, and code editing.
  • Work with other Datadog teams to expand capabilities, for example integrating with the Datadog IDE extensions to deliver a CoPilot-like assistant, or Dynamic Instrumentation to collect more runtime data from production and pre-production environments.

Who You Are:

  • You’re a backend engineer with at least 5 years of professional experience (Go, Java, Python) who values code simplicity and performance. You’ve shipped software that uses LLMs to production.
  • You are passionate about Generative AI and its ability to help software engineers be more productive.
  • You have relevant experience with Large Language Models, large-scale systems and data sets, machine learning, or adjacent fields.
  • You are a great community ambassador and can drive hard technical conversations towards a pragmatic solution.
  • You want to work in a fast, high-growth startup environment that respects its engineers and customers.
  • You have experience writing developer tools (such as IDEs, static code analysis tools, or compilers).

Skills

GoJavaPythonLLMsGenerative AIMachine LearningPrompt EngineeringAgent ToolsDeveloper ToolsLarge-Scale Systems

Similar roles

ML Engineering jobs
Datadog

Senior AI Engineer - APM Experiences

DatadogNew York, NY

Leads development of LLM- and agent-based features for Datadog's APM to detect, resolve, and prevent performance issues using traces, metrics, and logs. Requires 4+ years in backend/ML systems, production AI experience, and distributed systems expertise.

187k – 240k
On-site4+ YOEML Engineering
Coinbase

Senior Software Engineer - AI Platform Team

CoinbaseUnited States

Senior Software Engineer building and operating Coinbase's central LLM and AI agent platform infrastructure. Owns LLM Gateway, knowledge bases, agent runtime, FinOps, evaluation tooling, and cross-team applied AI strategy. Requires 5+ years building ML/AI infrastructure at scale.

186k – 219k
Remote5+ YOEML Engineering
Cribl

Sr Software Engineer, Cribl AI

CriblUnited States

Build and productionize AI integrations across Cribl's observability platform. Requires 5+ years building AI features end-to-end with fullstack experience in React, TypeScript/JavaScript, and backend systems plus hands-on LLM/agent work.

185k – 215k
Remote5+ YOEML Engineering
Cribl

Sr Machine Learning Engineer, AI Research

CriblUnited States

Design, train, and productionize ML models and pipelines for AI-enabled security/observability platforms. Requires 4+ years experience with Python, PyTorch/TensorFlow, and modern ML techniques.

185k – 215k
Remote4+ YOEML Engineering
Zoox

Senior Machine Learning Engineer - Scene Understanding

ZooxFoster City, CA +1

Develops advanced Vision-Language-Action models for robotaxi scene understanding, detecting hazards and enabling safe driving. Leads data strategies, post-training of large models, and deployment using PyTorch and production ML pipelines. Requires MS/PhD in CS and deep learning expertise.

189k – 290k
HybridML Engineering