Staff+ Software Engineer, Infrastructure
Leads the architecture, delivery, and operation of large-scale infrastructure and distributed systems supporting AI research and products. The role requires strong software engineering, cloud infrastructure expertise, cross-team technical leadership, and experience delivering complex production systems.
About the job
Responsibilities
- Independently scope and lead complex, multi-month infrastructure projects from an ambiguous starting point through production.
- Make architectural decisions that shape infrastructure foundations used by other engineers and teams.
- Drive alignment on technical direction across multiple teams through ambiguous problem spaces.
- Partner with research and product teams to understand infrastructure and compute needs and translate them into technical designs.
- Own the reliability, scalability, and security of systems as usage and complexity grow.
- Set technical strategy and standards for team infrastructure.
- Build and improve operational processes, including incident response, postmortems, and on-call rotations.
- Mentor engineers and help raise the team's technical bar.
Requirements
- Experience designing, building, and operating large-scale distributed systems or infrastructure in production.
- Track record of independently scoping and delivering complex, ambiguous, multi-month technical projects.
- Experience making architectural decisions that other engineers and teams build on.
- Strong software engineering fundamentals and proficiency in at least one programming language, such as Python, Rust, Go, or Java.
- Experience with modern cloud infrastructure, including Kubernetes and infrastructure as code, on AWS and/or Google Cloud.
- Strong written and verbal communication skills, including experience driving alignment across multiple teams or stakeholders.
- Bachelor's degree or an equivalent combination of education, training, and experience.
Nice-to-haves
- 10+ years of software engineering experience, excluding internships.
- Experience with machine learning infrastructure, including GPUs, TPUs, or Trainium, and associated networking infrastructure such as NCCL.
- Low-level systems experience, such as Linux kernel tuning or eBPF.
- Background in security or privacy engineering best practices.
- Prior experience as a technical lead or mentor for engineers.
Compensation and Benefits
- Annual salary range: $320,000–$485,000 USD.
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Office space for collaboration.
- The role follows a location-based hybrid policy; staff are currently expected to work from an office at least 25% of the time, with some roles requiring more office time.
- Visa sponsorship may be available.
Skills
Distributed Systems, Kubernetes, Infrastructure As Code, AWS, GCP, Python, Rust, Go, Java, Machine Learning Infrastructure, Gpus, Tpus, Linux Kernel, Ebpf, Nccl
Similar jobs
Backend Engineering jobs
Anthropic
San Francisco, CA
Design and operate high-QPS backend systems on Claude’s token-generation path, owning latency, reliability, safe deployments, and incident response. The role requires 8+ years of software engineering experience, strong distributed-systems expertise, and production ownership of mission-critical services.
Anthropic
San Francisco, CABuild and scale distributed inference infrastructure serving Claude across accelerators and cloud providers. The role requires substantial software engineering experience, with expertise in large-scale systems, routing, orchestration, and production machine learning infrastructure.
Earnin
Mountain View, CA
This Senior Staff Software Engineer will define and lead the architecture of EarnIn’s Identity & Trust platform, spanning authentication, authorization, verification, privacy, fraud prevention, and secure data processing. The role requires 8+ years of software engineering experience and deep expertise in secure distributed backend systems.
Coinbase
United States
Sets architectural direction and remains hands-on in building ultra-low-latency institutional trading systems spanning matching, risk, order management, and market data. Requires 10+ years of software engineering experience and deep expertise in distributed systems and backend performance.
Vanta
Remote
Leads architecture and technical strategy for Vanta’s government compliance product, building scalable backend systems and new workflows in a 0-to-1 environment. Requires 10+ years of backend experience, strong systems thinking, cross-functional influence, and a track record of mentoring engineers.