Skip to content
OpenAIOpenAISan Francisco, CA

Software Engineer, Compute Infrastructure

Builds and optimizes large-scale compute infrastructure for AI workloads, spanning hardware automation, distributed systems, Kubernetes orchestration, networking, storage, and developer tools. Requires strong systems engineering experience in performance, reliability, and production infrastructure.

230k – 405k/yr
HybridDevOps / SRE

About the role

Responsibilities

  • Build and deeply optimize reliable system software for large-scale compute systems that run some of the world's most demanding AI workloads
  • Design and operate infrastructure across accelerators, CPUs, NICs, switches, networking protocols, storage, data centers, cluster orchestration, scheduling, and fleet health
  • Profile, benchmark, and optimize training workloads across compute, memory, storage, networking, NCCL and collective communication, and cluster scheduling bottlenecks
  • Create hardware-aware automation that makes provisioning, firmware and driver upgrades, incident response, and day-to-day operations faster and less error-prone
  • Build CaaS, agent infrastructure, profiling, observability, benchmarking, and platform tools that help researchers, product engineers, and operators launch, debug, and optimize workloads with less friction
  • Turn operational lessons into better systems, stronger abstractions, and clearer ownership boundaries across teams
  • Collaborate across research, engineering, security, networking, hardware, and data center teams to make compute capacity more capable and easier to use

Qualifications

  • Strong software engineering skills and experience building, operating, or improving production infrastructure systems
  • Experience in one or more relevant areas such as distributed systems, operating systems, networking protocols, RDMA, NCCL or collective communication, storage, Kubernetes, scheduling, observability, reliability engineering, high-performance computing, GPU infrastructure, CaaS, agent infrastructure, hardware-aware performance optimization, benchmarking, developer experience, or infrastructure tooling
  • Ability to debug complex system behavior across software, hardware, networking, and workload layers, then turn findings into robust improvements
  • Comfort with ambiguity, strong ownership, and a bias toward practical, durable solutions

Skills

KubernetesNcclRdmaDistributed SystemsHigh-Performance ComputingGpu InfrastructureObservabilityReliability EngineeringStorage SystemsNetworking Protocols

Similar roles

DevOps / SRE jobs
OpenAI

Software Engineer, Productivity - Inference Runtime

OpenAISan Francisco, CA

Builds and improves CI/CD, testing, validation, and release tooling for OpenAI's inference runtime teams to ensure reliable, performant model deployments across ChatGPT, API, and research workloads. Requires strong Python skills, developer productivity experience, and high ownership in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Core Network Engineering

OpenAISan Francisco, CA

Builds and operates high-performance networking infrastructure for OpenAI's large-scale AI training and inference, focusing on host networking, datacenter fabrics, and WAN systems. Optimizes latency, reliability, and scalability using technologies like RDMA, InfiniBand, and RoCE; requires strong systems programming in C++, Python, or Go.

230k – 342k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Productivity - Model Performance

OpenAISan Francisco, CA

Builds and improves developer tools, CI/CD pipelines, and testing workflows to boost productivity for OpenAI's model performance engineering teams. Requires strong Python skills, experience with developer infrastructure, and ability to work in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Productivity - Networking

OpenAISan Francisco, CA

Enhances developer productivity for OpenAI's networking team by improving build systems, CI/CD pipelines, test harnesses, and workflows for C++ and Python codebases in multi-server environments. Requires experience with developer tools and infrastructure automation.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Infrastructure - Analytics Platform

OpenAISan Francisco, CA

Owns end-to-end production-critical infrastructure for analytics platform, building performant backend systems in Rust or C++ and operating distributed services at scale on Kubernetes. Requires strong systems experience in performance optimization, debugging, and on-call reliability.

230k – 385k/yr
HybridDevOps / SRE