# Staff + Senior Software Engineer, Scaling

**Company:** [Anthropic](https://hotfix.jobs/companies/anthropic)
**Location:** San Francisco, CA, Seattle, WA
**Role:** Backend Engineering
**Salary:** $320k – $485k/yr
**Experience:** 7+ years
**Skills:** Distributed Systems, Machine Learning Systems, Load Balancing, Request Routing, Traffic Management, Llm Inference, Kubernetes, AWS, GCP, Microsoft Azure, Python, Rust, Autoscaling, Caching, Observability
**Posted:** 2026-08-24

> Build and scale distributed inference infrastructure serving Claude across accelerators and cloud providers. The role requires substantial software engineering experience, with expertise in large-scale systems, routing, orchestration, and production machine learning infrastructure.

## Job Description

## Responsibilities
- Design, build, and maintain distributed systems serving Claude to millions of users worldwide.
- Develop resilient systems that adapt in real time to operational events.
- Build intelligent request routing, load balancing, and traffic management across accelerators and cloud providers.
- Improve compute efficiency and fleet cost through autoscaling and workload orchestration.
- Build and operate production-grade deployment pipelines for releasing new models.
- Provide high-performance inference infrastructure for model research.
- Integrate new AI accelerator platforms and support new model architectures.
- Analyze observability data to tune production performance.
- Manage multi-region deployments and geographic routing.

## Requirements
- Significant software engineering experience, particularly with distributed systems.
- Results-oriented, flexible, and impact-focused approach.
- Willingness to take on work outside the formal job description.
- Interest in machine learning systems and infrastructure.
- Ability to thrive where technical excellence drives business and research outcomes.
- Care for the societal impacts of the work.
- Bachelor’s degree or equivalent combination of education, training, and experience in a relevant field.

## Nice-to-haves
- Experience with high-performance, large-scale distributed systems.
- Experience implementing and deploying machine learning systems at scale.
- Experience with load balancing, request routing, or traffic management.
- Familiarity with LLM inference optimization, batching, and caching strategies.
- Experience with Kubernetes and cloud infrastructure.
- Proficiency in Python or Rust.

## Compensation and benefits
- Annual salary: **$320,000–$485,000 USD**.
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Office collaboration space.

## Similar jobs

- [Staff+ Software Engineer, ML Sampling Path](https://hotfix.jobs/jobs/51875859-1e83-4359-9d31-34a0b2c809d1) - Anthropic - San Francisco, CA - $320k – $485k/yr
- [Senior Staff Software Engineer](https://hotfix.jobs/jobs/dee0f79b-db20-42d6-bb5c-0d4385927334) - Earnin - Mountain View, CA - $279k – $341k/yr
- [Senior Staff Software Engineer, Institutional Exchange](https://hotfix.jobs/jobs/a60cae28-0009-445d-8f68-7c2072aebd3a) - Coinbase - Remote - $263k – $309k/yr
- [Staff Software Engineer, GRC](https://hotfix.jobs/jobs/3a506b48-97b0-44a6-8c94-1b8de6be5ad9) - Vanta - Remote - $260k – $306k/yr
- [Senior Staff Software Engineer, Finhub](https://hotfix.jobs/jobs/1951727b-0f94-41ad-a9e8-bd7a603a152d) - Coinbase - Remote - $254k – $299k/yr

**Apply:** https://hotfix.jobs/jobs/e788139e-a7e1-4e18-86aa-1645f2e1ef75
**Canonical:** https://hotfix.jobs/jobs/e788139e-a7e1-4e18-86aa-1645f2e1ef75