# Staff Software Engineer, Inference

**Company:** [Anthropic](https://hotfix.jobs/companies/anthropic)
**Location:** Dublin, Ireland, London, United Kingdom
**Role:** ML Engineering
**Salary:** £325k – £390k/yr
**Experience:** 7+ years
**Skills:** Python, Rust, Distributed Systems, Kubernetes, AWS, GCP, Microsoft Azure, Load Balancing, Request Routing, Autoscaling, Llm Inference, Machine Learning Systems, Gpus, Tpus, Caching
**Posted:** 2026-08-03

> Build and operate high-performance distributed inference infrastructure serving Claude across large-scale accelerator fleets. The role requires strong software engineering experience with production distributed systems, Kubernetes, cloud platforms, and machine learning infrastructure.

## Job Description

## Responsibilities
- Design, build, and maintain distributed systems that serve Claude to millions of users worldwide.
- Develop resilient, flexible systems that adapt in real time to real-world events.
- Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators.
- Maximize compute efficiency across the fleet through autoscaling and orchestration of production, research, and experimental workloads.
- Build and operate production-grade deployment pipelines for releasing new models to users.
- Provide high-performance inference infrastructure for next-generation model development.
- Integrate new AI accelerator platforms and support inference for new model architectures.

## Minimum Qualifications
- Proficiency in Python or Rust.
- Software engineering experience building and operating distributed systems in production.
- Working knowledge of containerized infrastructure, such as Kubernetes, and at least one major cloud platform: AWS, GCP, or Azure.
- Results-oriented, flexible, and impact-focused.
- Willingness to take on work beyond the formal job description.
- Desire to learn more about machine learning systems and infrastructure.
- Ability to thrive where technical excellence drives business results and research breakthroughs.
- Care about the societal impacts of the work.

## Preferred Qualifications
- Significant experience with high-performance, large-scale distributed systems.
- Experience implementing and deploying machine learning systems at scale.
- Experience building load balancing, request routing, or traffic management systems.
- Familiarity with LLM inference optimization, batching, and caching strategies.
- Deep experience operating Kubernetes and cloud infrastructure at scale.
- Experience with AI accelerator platforms, including GPUs, TPUs, or emerging hardware.

## Representative Projects
- Design intelligent routing algorithms to optimize request distribution across accelerators and environments.
- Autoscale the compute fleet to match supply with demand across production, research, and experimental workloads.
- Build production-grade deployment pipelines for reliably releasing new models to millions of users.
- Contribute to new inference features and support inference for new model architectures.
- Analyze observability data to tune performance based on real-world production workloads.
- Manage multi-region deployments and geographic routing for global customers.

## Compensation and Benefits
- Annual salary: **£325,000–£390,000 GBP**.
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Office collaboration space.
- Minimum education: bachelor’s degree or an equivalent combination of education, training, and experience.
- Visa sponsorship is available for eligible roles and candidates.

## Similar jobs

- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/2cb6da8f-4a54-448d-a4b6-fc05f1412a12) - Payabli - Remote
- [Senior AI Engineer – Notebooks](https://hotfix.jobs/jobs/fed3b705-a67d-4a63-8cff-b6c19357b4f7) - Datadog - Bordeaux, France
- [Senior Data Scientist](https://hotfix.jobs/jobs/0034bffa-ad4e-411a-b969-9921deaba695) - MongoDB - Cork, Ireland
- [Senior Machine Learning Engineer, Ads Foundational Representations](https://hotfix.jobs/jobs/64d15c9c-657b-4970-bb94-06bb332d282d) - Reddit - Remote
- [Senior MLOps Engineer - Edge](https://hotfix.jobs/jobs/2a445c7f-aa55-47d9-bcf0-2e6f7a009288) - Hudl - Remote

**Apply:** https://hotfix.jobs/jobs/a0de0df0-61e6-4578-b3b1-c4e53520fcc1
**Canonical:** https://hotfix.jobs/jobs/a0de0df0-61e6-4578-b3b1-c4e53520fcc1