# Staff Software Engineer, Node Infra

**Company:** [Anthropic](https://hotfix.jobs/companies/anthropic)
**Location:** San Francisco, CA, New York, NY, Seattle, WA
**Role:** DevOps / SRE
**Salary:** $405k – $485k/yr
**Experience:** 12+ years
**Skills:** Kubernetes, Terraform, AWS, GCP, Azure, Rust, Go, Python, Gpus, Tpus, Distributed Systems, Iac
**Posted:** 2026-06-17

> Own technical strategy and roadmap for node lifecycle management, health automation, and scaling AI clusters across clouds and accelerators. Requires deep distributed systems expertise, ML accelerator experience, and 12+ years leading complex multi-team infrastructure initiatives.

## Job Description

## Key responsibilities
- Own the technical strategy and roadmap for node lifecycle management - ingestion, bring-up, health checking, and automated repair
- Drive cross-team initiatives to build and scale AI clusters across multiple clouds and accelerator families
- Design and operate the systems that detect, isolate, and remediate unhealthy hardware automatically, driving up fleet MTBI and minimizing stranded capacity
- Define infrastructure architecture, ensuring the hardest problems get solved - whether by you directly or by working through others
- Work closely with cloud providers and internal research/inference/product teams to shape long-term compute, data, and infrastructure strategy
- Establish and evolve operational excellence practices (incident response, postmortem culture, on-call)
- Support the growth of engineers around you through technical mentorship and coaching

## Minimum qualifications
- Deep expertise in distributed systems, reliability, and cloud platforms (e.g., Kubernetes, IaC, AWS/GCP/Azure)
- Strong proficiency in at least one systems language (e.g., Rust, Go, or Python), IaC proficiency with Terraform
- Hands-on experience with machine learning accelerators (GPUs, TPUs, or Trainium)
- Track record of leading complex, multi-quarter technical initiatives that span multiple teams or systems
- Ability to build alignment across senior stakeholders and communicate effectively at all levels

## Preferred qualifications
- 12+ years of software engineering experience, including time as a technical lead setting direction for a team
- Experience managing large scale compute infrastructure at hyperscale (10K+ nodes), including capacity management and efficiency
- Depth in one or more of: Kubernetes internals (scheduler, autoscaler, kubelet, Karpenter), cluster orchestration systems (Mesos, Borg-like), or node provisioning pipelines
- Low-level systems experience: kernel, virtualization, device drivers, firmware, or hardware health/diagnostics daemons
- Familiarity with high-performance networking (EFA, RDMA, InfiniBand) for distributed ML workloads
- Demonstrated ownership of production reliability for high-throughput, latency-sensitive systems
- Contributions to relevant open-source projects (Kubernetes, Linux kernel, container runtimes, etc.)
- Skill in quickly understanding systems design tradeoffs and keeping track of rapidly evolving software systems

## Compensation
- Annual Salary: $405,000—$485,000 USD

## Similar roles

- [[Pipeline] Staff+ Software Engineer, Experimentation](https://hotfix.jobs/jobs/5019f14b-9e61-42dc-8785-8c491102e453) - Anthropic - San Francisco, CA - $405k – $485k/yr
- [[Pipeline] Staff+ Software Engineer, Developer Acceleration](https://hotfix.jobs/jobs/a301a0ca-b5e3-43d9-b15c-bbafbd846475) - Anthropic - San Francisco, CA - $405k – $485k/yr
- [Staff Software Engineer, Developer Productivity](https://hotfix.jobs/jobs/a5e1ea7e-e706-4c47-9396-c02ab749471a) - Anthropic - San Francisco, CA - $405k – $485k/yr
- [Staff Software Engineer, Developer Productivity](https://hotfix.jobs/jobs/5a672e92-7540-4fb4-aee3-5f2bb4cf9d90) - Anthropic - San Francisco, CA - $405k – $485k/yr
- [Staff Software Engineer, Kubernetes Platform](https://hotfix.jobs/jobs/7e63c837-e76b-473c-9dc0-0049d23ee786) - Anthropic - San Francisco, CA - $405k – $485k/yr

**Apply:** https://hotfix.jobs/jobs/555674d3-0ef3-4c51-88bc-655c04cccda6
**Canonical:** https://hotfix.jobs/jobs/555674d3-0ef3-4c51-88bc-655c04cccda6