Builds and optimizes large-scale compute infrastructure for AI workloads, spanning hardware automation, distributed systems, Kubernetes orchestration, networking, storage, and developer tools. Requires strong systems engineering experience in performance, reliability, and production infrastructure.
230k – 405k/yr
HybridDevOps / SRE
About the role
Responsibilities
Build and deeply optimize reliable system software for large-scale compute systems that run some of the world's most demanding AI workloads
Design and operate infrastructure across accelerators, CPUs, NICs, switches, networking protocols, storage, data centers, cluster orchestration, scheduling, and fleet health
Profile, benchmark, and optimize training workloads across compute, memory, storage, networking, NCCL and collective communication, and cluster scheduling bottlenecks
Create hardware-aware automation that makes provisioning, firmware and driver upgrades, incident response, and day-to-day operations faster and less error-prone
Build CaaS, agent infrastructure, profiling, observability, benchmarking, and platform tools that help researchers, product engineers, and operators launch, debug, and optimize workloads with less friction
Turn operational lessons into better systems, stronger abstractions, and clearer ownership boundaries across teams
Collaborate across research, engineering, security, networking, hardware, and data center teams to make compute capacity more capable and easier to use
Qualifications
Strong software engineering skills and experience building, operating, or improving production infrastructure systems
Experience in one or more relevant areas such as distributed systems, operating systems, networking protocols, RDMA, NCCL or collective communication, storage, Kubernetes, scheduling, observability, reliability engineering, high-performance computing, GPU infrastructure, CaaS, agent infrastructure, hardware-aware performance optimization, benchmarking, developer experience, or infrastructure tooling
Ability to debug complex system behavior across software, hardware, networking, and workload layers, then turn findings into robust improvements
Comfort with ambiguity, strong ownership, and a bias toward practical, durable solutions
Builds and improves CI/CD, testing, validation, and release tooling for OpenAI's inference runtime teams to ensure reliable, performant model deployments across ChatGPT, API, and research workloads. Requires strong Python skills, developer productivity experience, and high ownership in ambiguous environments.
230k – 385k/yr
On-siteDevOps / SRE
Software Engineer, Core Network Engineering
OpenAISan Francisco, CA
Builds and operates high-performance networking infrastructure for OpenAI's large-scale AI training and inference, focusing on host networking, datacenter fabrics, and WAN systems. Optimizes latency, reliability, and scalability using technologies like RDMA, InfiniBand, and RoCE; requires strong systems programming in C++, Python, or Go.
230k – 342k/yr
On-siteDevOps / SRE
Software Engineer, Productivity - Model Performance
OpenAISan Francisco, CA
Builds and improves developer tools, CI/CD pipelines, and testing workflows to boost productivity for OpenAI's model performance engineering teams. Requires strong Python skills, experience with developer infrastructure, and ability to work in ambiguous environments.
230k – 385k/yr
On-siteDevOps / SRE
Software Engineer, Productivity - Networking
OpenAISan Francisco, CA
Enhances developer productivity for OpenAI's networking team by improving build systems, CI/CD pipelines, test harnesses, and workflows for C++ and Python codebases in multi-server environments. Requires experience with developer tools and infrastructure automation.
Owns end-to-end production-critical infrastructure for analytics platform, building performant backend systems in Rust or C++ and operating distributed services at scale on Kubernetes. Requires strong systems experience in performance optimization, debugging, and on-call reliability.