Designs and builds distributed failure detection, tracing, and observability systems for large-scale AI training jobs. Requires deep expertise in performance, distributed systems, hardware, networking, and low-level software engineering.
310k – 460k/yr
On-siteDevOps / SRE
About the role
In This Role, You Will
Design and build distributed failure detection, tracing, and profiling systems for large-scale AI training jobs
Develop tooling to identify slow, faulty, or misbehaving nodes and provide actionable visibility into system behavior
Improve observability, reliability, and performance across OpenAI’s training platform
Debug and resolve issues in complex, high-throughput distributed systems
Collaborate with systems, infrastructure, and research teams to evolve platform capabilities
Extend and adapt failure detection systems or tracing systems to support new training paradigms and workloads
You Might Thrive in This Role If You
Care deeply about performance, stability, and observability in distributed systems
Enjoy finding and fixing issues in large-scale systems and automating operational workflows
Have experience writing low-level software where system details matter
Understand hardware, operating systems, networking, concurrency, and distributed systems
Have a background in high-performance computing or low-level systems engineering
Are excited to work on critical infrastructure that powers frontier AI research
Optimizes performance across Codex AI system's stack including LLM inference, cloud orchestration, and agent behavior to reduce latency and costs. Collaborates with researchers and engineers on high-impact improvements in a high-ownership role.
295k – 445k/yr
HybridDevOps / SRE
Tokens-as-a-Service (Taas) Software Engineer
OpenAISan Francisco, CA +1
Builds systems and tooling to measure, monitor, and optimize token throughput from GPU infrastructure for OpenAI workloads. Integrates partner compute environments, benchmarks performance, analyzes tokenomics, and develops operational metrics and dashboards. Requires strong distributed systems and infrastructure engineering experience.
293k – 455k/yr
HybridDevOps / SRE
SW Engineer, Hardware and System Bring-up/Bootstrapping - Industrial Compute, Scaling
OpenAISeattle, WA
Engineers handle hardware and system bring-up for industrial compute, bootstrapping bare metal nodes into schedulable Kubernetes fleet capacity. Requires 5+ years in Linux infrastructure, IaC tools like Terraform/Chef, and debugging boot/provisioning issues.
293k – 455k/yr
On-site5+ YOEDevOps / SRE
Release Engineer, Consumer Products
OpenAISan Francisco, CA
Designs and operates CI/CD pipelines and release infrastructure for multi-component systems including bootloaders, firmware, and OTA updates. Requires strong automation skills in Python/Bash, Linux expertise, and experience with build systems for embedded/consumer products.
293k – 325k/yr
HybridDevOps / SRE
Incident Response Manager - Product & Engineering
AnthropicNew York, NY +2
Leads incident response operations for product and engineering, serving as on-call commander to coordinate cross-functional teams, manage communications, and improve processes during high-stakes incidents. Requires 5+ years in incident management with technical depth in infrastructure and cloud systems.