Software Engineer, AI Reliability

Responsibilities

• Develop appropriate Service Level Objectives for large language model serving systems, balancing availability and latency with development velocity.
• Design and implement monitoring and observability systems across the token path.
• Assist in the design and implementation of high-availability serving infrastructure across multiple regions and cloud providers.
• Lead incident response for critical AI services, ensuring rapid recovery, thorough incident reviews, and systematic improvements.
• Support the reliability of safeguard model serving—critical for both site reliability and Anthropic's safety commitments.

You may be a good fit if you

• Have strong distributed systems, infrastructure, or reliability backgrounds—we're looking for reliability-minded software engineers and SREs.
• Are curious and brave—comfortable jumping into unfamiliar systems during an incident and helping drive resolution even when you don't have deep expertise yet.
• Think holistically about how systems compose and where the seams are.
• Can build lasting relationships across teams—our engagement model depends on being welcomed as teammates, not outsiders with opinions.
• Care about users and feel ownership over outcomes, even for systems you don't own.
• Have excellent communication and collaboration skills—you'll be partnering across the entire company.
• Bring diverse experience—the team's strength comes from people who've built product stacks, scaled databases, run massive distributed systems, and everything in between.

Strong candidates may also

• Have been an SRE, Production Engineer, or in similar reliability-focused roles on large scale systems.
• Have experience operating large-scale model serving or training infrastructure (>1000 GPUs).
• Have experience with one or more ML hardware accelerators (GPUs, TPUs, Trainium).
• Understand ML-specific networking optimizations like RDMA and InfiniBand.
• Have expertise in AI-specific observability tools and frameworks.
• Have experience with chaos engineering and systematic resilience testing.
• Have contributed to open-source infrastructure or ML tooling.

Logistics

Annual Salary: $325,000—$485,000 USD

Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience.

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.