# Staff Software Engineer, Inference

**Company:** [Anthropic](https://hotfix.jobs/companies/anthropic)
**Location:** Dublin, Ireland
**Role:** Backend Engineering
**Salary:** €295k – €355k/yr
**Experience:** 7+ years
**Skills:** Distributed Systems, Machine Learning Systems, Llm Inference, Load Balancing, Request Routing, Traffic Management, Kubernetes, AWS, GCP, Python, Rust, Caching, Autoscaling, Multi-Accelerator Deployments, Observability
**Posted:** 2026-08-03

> Build and optimize large-scale distributed inference infrastructure serving Claude across diverse AI accelerators and cloud platforms. The role requires significant software engineering experience with distributed systems; expertise in LLM inference, Kubernetes, cloud infrastructure, Python, or Rust is advantageous.

## Job Description

## Responsibilities

- Build and maintain critical systems serving Claude to millions of users worldwide.
- Address infrastructure blockers across the inference stack, from intelligent request routing to fleet-wide orchestration across diverse AI accelerators.
- Maximize compute efficiency while enabling high-performance inference infrastructure for AI research.
- Design intelligent routing algorithms that optimize request distribution across thousands of accelerators.
- Autoscale compute fleets to match supply and demand across production, research, and experimental workloads.
- Build production-grade deployment pipelines for releasing new models.
- Integrate new AI accelerator platforms.
- Contribute to inference features such as structured sampling and prompt caching.
- Support inference for new model architectures.
- Analyze observability data to tune performance based on production workloads.
- Manage multi-region deployments and geographic routing.

## Requirements

- Significant software engineering experience, particularly with distributed systems.
- Experience with high-performance, large-scale distributed systems.
- Experience implementing and deploying machine learning systems at scale.
- Results-oriented approach with flexibility and a focus on impact.
- Willingness to take on work outside the formal job description.
- Interest in machine learning systems and infrastructure.
- Ability to thrive in environments where technical excellence drives business and research outcomes.
- Care about the societal impacts of the work.
- Bachelor's degree or equivalent combination of education, training, and experience in a relevant field.

## Nice-to-haves

- Load balancing, request routing, or traffic management systems.
- LLM inference optimization, batching, and caching strategies.
- Kubernetes and cloud infrastructure, including AWS or GCP.
- Python or Rust.
- Multi-accelerator deployments.

## Compensation and benefits

- Annual salary: **€295,000–€355,000 EUR**.
- Hybrid policy requiring staff to work from an office at least 25% of the time; some roles may require more.
- Visa sponsorship may be available.
- Competitive benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration space.

## Similar jobs

- [Staff Software Engineer, GRC](https://hotfix.jobs/jobs/3a506b48-97b0-44a6-8c94-1b8de6be5ad9) - Vanta - Remote - $260k – $306k/yr
- [Staff Engineer - Data Platform Experience](https://hotfix.jobs/jobs/83c4a3b7-0151-42a8-8538-2949b6b83346) - Datadog - Lisbon, Portugal
- [Staff Engineer, Observability](https://hotfix.jobs/jobs/c8e7a189-0a99-4bd6-8516-54259091cfef) - MongoDB - Dublin, Ireland
- [Staff Engineer](https://hotfix.jobs/jobs/354d25d7-876c-4626-bf3e-7563e8a7cffd) - MongoDB - Dublin, Ireland
- [Staff Software Engineer, Server Networking Security](https://hotfix.jobs/jobs/4e004e84-ee65-4d0f-afcb-28d486e84910) - MongoDB - Cork, Ireland

**Apply:** https://hotfix.jobs/jobs/89d22a1b-ae85-45c8-9660-5f213727221d
**Canonical:** https://hotfix.jobs/jobs/89d22a1b-ae85-45c8-9660-5f213727221d