# Software Engineer, Frontier Clusters Infrastructure

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** DevOps / SRE
**Salary:** $230k – $490k/yr
**Skills:** Kubernetes, Python, Go, Terraform, Linux, GPU, Distributed Systems, Infrastructure As Code, Bare Metal, Networking
**Posted:** 2024-11-07

> Builds and scales massive Kubernetes clusters for OpenAI's frontier supercomputers, automates bare-metal provisioning, and ensures reliability across data centers for AI model training. Requires expertise in distributed systems, Kubernetes operations, and infrastructure automation.

## Job Description

## Responsibilities
- Spin up and scale large Kubernetes clusters, including automation for provisioning, bootstrapping, and cluster lifecycle management
- Build software abstractions that unify multiple clusters and present a seamless interface to training workloads
- Own node bring-up from bare metal through firmware upgrades, ensuring fast, repeatable deployment at massive scale
- Improve operational metrics such as reducing cluster restart times (e.g., from hours to minutes) and accelerating firmware or OS upgrade cycles
- Integrate networking and hardware health systems to deliver end-to-end reliability across servers, switches, and data center infrastructure
- Develop monitoring and observability systems to detect issues early and keep clusters stable under extreme load

## Requirements
- Deep experience operating or scaling Kubernetes clusters or similar container orchestration systems in high-growth or hyperscale environments
- Strong programming or scripting skills (**Python**, **Go**, or similar) and familiarity with Infrastructure-as-Code tools such as **Terraform** or **CloudFormation**
- Comfortable with bare-metal Linux environments, GPU hardware, and large-scale networking
- Experience as an infrastructure, systems, or distributed systems engineer in large-scale or high-availability environments
- Strong knowledge of Kubernetes internals, cluster scaling patterns, and containerized workloads
- Proficiency in cloud infrastructure concepts (compute, networking, storage, security) and in automating cluster or data center operations

## Nice-to-Haves
- Background with GPU workloads, firmware management, or high-performance computing

## Similar roles

- [Software Engineer, Productivity - Inference Runtime](https://hotfix.jobs/jobs/69dc68e4-afb2-408a-99b3-d0a75f5b59a5) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Core Network Engineering](https://hotfix.jobs/jobs/edc46bbe-94a3-427d-8e51-12997465af0c) - OpenAI - San Francisco, CA - $230k – $342k/yr
- [Software Engineer, Productivity - Model Performance](https://hotfix.jobs/jobs/02edb47f-3a80-4c92-97af-12456fa045ea) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Productivity - Networking](https://hotfix.jobs/jobs/6c5db7b0-2fe1-4065-86b8-431a296ad080) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Compute Infrastructure](https://hotfix.jobs/jobs/35add999-67ee-4269-8975-f19937c751aa) - OpenAI - San Francisco, CA - $230k – $405k/yr

**Apply:** https://hotfix.jobs/jobs/78e8a7a4-ca98-452b-8f12-4ff6b1353940
**Canonical:** https://hotfix.jobs/jobs/78e8a7a4-ca98-452b-8f12-4ff6b1353940