Skip to content

Staff Software Engineer, Kubernetes Platform

320k – 405kSan Francisco, CANew York, NYSeattle, WAHybrid8+ YOE
Summary

Staff engineer scales massive Kubernetes clusters for AI model training, owning scheduler, control plane, and core services for reliability at extreme scale. Requires deep Kubernetes expertise, systems programming, and 8+ years experience.

About the role

Key Responsibilities

  • Own, operate, and extend the Kubernetes scheduler for Anthropic's accelerator fleets, including custom scheduling plugins and policies for gang scheduling, topology awareness, and preemption
  • Scale the Kubernetes control plane (apiserver, etcd, controller-manager) to support clusters far beyond typical limits, and find the next bottleneck before it finds us
  • Design, build, and operate core cluster services such as service discovery that every workload in the fleet depends on
  • Build and maintain custom controllers, operators, and CRDs
  • Partner with research, training, and inference to understand workload shapes and turn their requirements into platform capabilities
  • Collaborate with cloud providers on required features and escalations
  • Participate in on-call, lead incident response, and design processes (postmortems, runbooks, SLOs) that help the team avoid repeating failures

Minimum Qualifications

  • Significant software engineering experience building and operating production distributed systems
  • Proficiency in at least one systems-appropriate language (Go, Python, Rust, or C++)
  • Deep, hands-on Kubernetes experience (well beyond "user of”) into scheduler, controllers, apiserver, or operating large multi-tenant clusters
  • Demonstrated ability to debug complex issues across the stack, from API behavior down to node and network-level root causes
  • A track record of designing for reliability, correctness, and clear failure semantics in systems other engineers depend on
  • Strong written and verbal communication; comfort building consensus with internal stakeholders

Preferred Qualifications

  • Experience with Kubernetes internals or contributions: kube-scheduler / scheduling framework, apiserver, etcd, client-go, controller-runtime, or similar
  • Experience building or operating cluster schedulers or batch systems (e.g., Kueue, Volcano, Slurm, or in-house equivalents)
  • Background scaling control planes or coordination systems (etcd, ZooKeeper, Consul, or large DNS/service-mesh deployments)
  • Familiarity with ML infrastructure: GPUs, TPUs, or Trainium; gang scheduling; topology-aware placement; collective networking such as NCCL
  • Experience with GCP and/or AWS, including GKE/EKS internals and Infrastructure as Code
  • Low-level systems experience such as Linux kernel tuning, cgroups, or eBPF
  • 8+ years of relevant industry experience, including time leading large, ambiguous infrastructure projects
Skills
KubernetesGoPythonRustetcdGCPAWSGKEEKSeBPF
Similar roles at this salary range
All DevOps / SRE jobs →
Anthropic

Staff Software Engineer, Infrastructure Asset Systems

As a Staff Software Engineer, you will build and extend systems for tracking, governing, and reporting on infrastructure assets. This involves designing data models, workflow engines, and integrations with financial and procurement systems, ensuring compliance and auditability.

320k – 405kSan Francisco, CA +1DevOps / SREHybridGoSQL
Zoox

Senior Manager, Network Engineering & Infrastructure

Lead and mentor a network engineering team responsible for designing, deploying, and operating multi-site enterprise network infrastructure across data centers, cloud, offices, and vehicle facilities. Requires 10+ years of network experience with 5+ years in senior leadership.

272k – 327kFoster City, CADevOps / SREHybridQoSCisco
Anthropic

Performance Engineer, Inference Systems

Performance engineer focused on cross-layer investigations of Anthropic's inference fleet for Claude, optimizing throughput, latency, reliability, and correctness while building observability and partnering with kernel and serving teams.

350k – 850kSan Francisco, CA +2DevOps / SREHybridSQLPython
OpenAI

Tech Lead, Deployment & Operations — Custom Infrastructure

Lead deployment and operations for OpenAI’s custom silicon and systems into data center environments. Drive hardware bring-up, validation, production deployment, and fleet reliability at scale while leading a technical team.

342k – 445kSan Francisco, CADevOps / SREHybridToolingAutomation
Anthropic

Staff Fiber Network Engineer

Owns end-to-end physical layer of private global dark-fiber backbone network, including route design, fiber acquisition, vendor management, acceptance testing, and lifecycle management. Requires deep OSP/fiber expertise, optical transport knowledge, and 8+ years experience building fiber programs.

320k – 405kSan Francisco, CA +1DevOps / SREHybridGoGIS