Skip to content
OpenAIOpenAISan Francisco, CA

Software Engineer, Fleet Infrastructure

Designs, implements, and operates infrastructure systems for model training and deployment on a massive GPU fleet. Requires experience with hyperscale compute, Kubernetes, public clouds like Azure, and strong programming skills.

230k – 490k/yr
HybridDevOps / SRE

About the role

Responsibilities

  • Design, implement and operate components of our compute fleet including job scheduling, cluster management, snapshot delivery, and CI/CD systems.
  • Interface with researchers and product teams to understand workload requirements.
  • Collaborate with hardware, infrastructure, and business teams to provide a high utilization and high reliability service.

Requirements

  • Experience with hyperscale compute systems.
  • Strong programming skills.
  • Experience working in public clouds (especially Azure).
  • Experience working in Kubernetes.
  • Execution focused mentality paired with a rigorous focus on user requirements.

Nice-to-haves

  • Understanding of AI/ML workloads.

Skills

KubernetesAzureCI/CDJob SchedulingCluster ManagementSnapshot DeliveryHyperscale ComputeAi/Ml Workloads

Similar roles

DevOps / SRE jobs
OpenAI

Software Engineer, Productivity - Inference Runtime

OpenAISan Francisco, CA

Builds and improves CI/CD, testing, validation, and release tooling for OpenAI's inference runtime teams to ensure reliable, performant model deployments across ChatGPT, API, and research workloads. Requires strong Python skills, developer productivity experience, and high ownership in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Core Network Engineering

OpenAISan Francisco, CA

Builds and operates high-performance networking infrastructure for OpenAI's large-scale AI training and inference, focusing on host networking, datacenter fabrics, and WAN systems. Optimizes latency, reliability, and scalability using technologies like RDMA, InfiniBand, and RoCE; requires strong systems programming in C++, Python, or Go.

230k – 342k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Productivity - Model Performance

OpenAISan Francisco, CA

Builds and improves developer tools, CI/CD pipelines, and testing workflows to boost productivity for OpenAI's model performance engineering teams. Requires strong Python skills, experience with developer infrastructure, and ability to work in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Productivity - Networking

OpenAISan Francisco, CA

Enhances developer productivity for OpenAI's networking team by improving build systems, CI/CD pipelines, test harnesses, and workflows for C++ and Python codebases in multi-server environments. Requires experience with developer tools and infrastructure automation.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Compute Infrastructure

OpenAISan Francisco, CA +2

Builds and optimizes large-scale compute infrastructure for AI workloads, spanning hardware automation, distributed systems, Kubernetes orchestration, networking, storage, and developer tools. Requires strong systems engineering experience in performance, reliability, and production infrastructure.

230k – 405k/yr
HybridDevOps / SRE