# Systems Generalist, GPT Infrastructure

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA, Seattle, WA
**Role:** ML Engineering
**Salary:** $293k – $385k/yr
**Experience:** 8+ years
**Skills:** C++, Python, Go, Rust, Distributed Systems, Linux, Kubernetes, AWS, llvm, mlir, triton, CUDA, rocm, vLLM, sglang
**Posted:** 2026-07-17

> Build and operate an automated inference optimization platform spanning control planes, secure partner-side runners, compilers, and evaluation systems for new accelerator hardware. Requires 8+ years building large-scale distributed systems with strong performance and systems expertise.

## Job Description

## Key Responsibilities
- Design, build, and operate durable APIs and control-plane services for multi-hour or multi-day optimization campaigns, including scheduling, retries, budgets, checkpoints, artifact lineage, and observability.
- Build secure partner-side runner and grader software that can compile, execute, verify, and benchmark candidate artifacts on third-party accelerator hardware.
- Integrate hardware profiles, ISA and toolchain context, compilers, runtimes, and inference-serving engines into a repeatable optimization workflow.
- Turn research prototypes into reliable product surfaces with clear contracts, debuggable failure modes, reproducible outputs, and excellent developer ergonomics.
- Develop correctness and performance evaluation systems spanning latency, throughput, memory use, utilization, and cost efficiency.
- Build artifact, provenance, and qualification workflows that make optimized kernels, binaries, configurations, and reports safe to review and deploy.
- Collaborate with Research, Inference Engineering, Infrastructure, Security, Product, and Strategic Partnerships to deliver production-ready solutions.
- Drive technical architecture and execution across ambiguous, cross-functional initiatives that connect OpenAI systems with partner environments.

## Basic Qualifications
- 8+ years of professional software engineering experience building large-scale distributed systems, infrastructure platforms, or cloud services, or equivalent depth of experience.
- Strong programming skills in one or more of C++, Python, Go, or Rust.
- Experience designing and operating highly available backend systems, APIs, job orchestration systems, or durable workflows for production workloads.
- Strong understanding of distributed systems, Linux, networking, storage, containers, and modern cloud architectures.
- Experience debugging complex systems and using measurement, profiling, and benchmarks to guide engineering decisions.
- Proven ability to lead complex technical initiatives as a senior individual contributor and work effectively across organizational boundaries.

## Preferred Skills
- Experience with AI infrastructure, inference-serving systems, or large-scale machine learning systems.
- Experience with compilers, runtimes, kernel optimization, or performance engineering; familiarity with technologies such as LLVM, MLIR, Triton, CUDA, or ROCm is a plus.
- Familiarity with GPUs, accelerators, hardware architecture, ISA concepts, or vendor toolchains.
- Experience with inference-serving frameworks or engines such as vLLM, SGLang, Triton Inference Server, or similar systems.
- Experience building developer platforms, external APIs, remote execution systems, or secure partner-facing infrastructure.
- Experience working with strategic cloud, hardware, or infrastructure partners.

## Similar roles

- [Engineering Manager, MLE](https://hotfix.jobs/jobs/a5f3f530-a06f-4a3e-b202-47a34ac69cb8) - OpenAI - San Francisco, CA - $293k – $385k/yr
- [Software Engineer, Monetization ML Infrastructure](https://hotfix.jobs/jobs/451b22fd-95fa-4f01-957a-6493f7f97fcc) - OpenAI - San Francisco, CA - $293k – $441k/yr
- [Research Engineer / Research Scientist](https://hotfix.jobs/jobs/68b1e6f3-d1ca-46f0-b588-f8ce543d60a9) - OpenAI - San Francisco, CA - $295k – $555k/yr
- [Agent Post-Training, Artifacts Research](https://hotfix.jobs/jobs/d4b6b972-df16-4526-bd39-2f4f1d0d6112) - OpenAI - San Francisco, CA - $295k – $445k/yr
- [Agent Post-Training, Computer Use Research](https://hotfix.jobs/jobs/bed644e8-5cd3-49e6-8435-b932562b96ad) - OpenAI - San Francisco, CA - $295k – $445k/yr

**Apply:** https://hotfix.jobs/jobs/bf7253c3-8fbf-4c77-be74-43920a6ff8a7
**Canonical:** https://hotfix.jobs/jobs/bf7253c3-8fbf-4c77-be74-43920a6ff8a7