# Software Engineer, Agent Infrastructure

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA, New York, NY
**Role:** Backend Engineering
**Salary:** $230k – $385k/yr
**Skills:** Kubernetes, FastAPI, gRPC, Terraform, Kata, Firecracker, Gvisor, Sysbox, Container Orchestration, Machine Learning Infrastructure
**Posted:** 2025-05-30

> Builds and scales infrastructure for training and deploying AI agents, including novel container orchestration beyond Kubernetes, FastAPI/gRPC APIs, and Terraform-based systems. Collaborates with researchers on high-scale ML environments and production platforms for OpenAI products.

## Job Description

## Responsibilities
- Push massive compute clusters to their limits as a core contributor to a novel in-house container orchestration platform that scales beyond Kubernetes.
- Develop and maintain **FastAPI** and **gRPC** APIs serving as the interface for agentic infrastructure in training and production.
- Use **Terraform** to stand up and evolve complex infrastructure for research and production.
- Collaborate with research teams to stand up and optimize systems for novel AI training runs and experimental applications.

## Requirements
- Deep experience working on large-scale machine learning infrastructure, reasoning about training at scale, identifying bottlenecks, and engineering optimization solutions.
- Ability to build new things from 0-1 quickly and scale them 1,000,000x.
- Keen eye for performance and optimization in complex, globally-distributed systems.
- Experience with cloud platforms and infrastructure-as-code like **Terraform**.
- Driven by solving complex, ambiguous problems at the intersection of infrastructure scalability, virtualization efficiency, and agentic capabilities.
- Deep technical expertise in virtualization and containerization technologies (e.g. **Kata**, **Firecracker**, **gVisor**, **Sysbox**) and passion for optimizing runtime performance.

## Similar roles

- [Software Engineer, Codex -Enterprise Controls](https://hotfix.jobs/jobs/9fc148ac-afcb-4558-a41e-a772e8869a71) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Private Computing](https://hotfix.jobs/jobs/61850697-3157-406e-8968-ea0a1b8753cd) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Enterprise AI Platform](https://hotfix.jobs/jobs/487f3501-620e-4e9d-abf9-8c3e9c0d2034) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Codex Core Agents](https://hotfix.jobs/jobs/64559708-d350-4d5b-a023-0f3df0ab5cbd) - OpenAI - San Francisco, CA - $230k – $325k/yr
- [Software Engineer, Ads Monetization, Revenue Platform](https://hotfix.jobs/jobs/d23d02c1-1938-4b30-82a7-aa252a3f8154) - OpenAI - San Francisco, CA - $230k – $385k/yr

**Apply:** https://hotfix.jobs/jobs/9d695fbd-b116-4ece-b171-2d4b010c12cc
**Canonical:** https://hotfix.jobs/jobs/9d695fbd-b116-4ece-b171-2d4b010c12cc