Skip to content
OpenAIOpenAISan Francisco, CA

Software Engineer, GPU Infrastructure - HPC

Software engineer focused on reliability and uptime of OpenAI's GPU/HPC compute fleet through automation, monitoring tools, and performance optimization. Requires proficiency in Python/Go, Linux, networking, and data analysis skills.

230k – 490k/yr
On-siteDevOps / SRE

About the role

In this role, you will:

  • Build and maintain automation systems for provisioning and managing server fleets.
  • Develop tools to monitor server health, performance, and lifecycle events.
  • Collaborate with clusters, networking, and infrastructure teams.
  • Partner with external operators to ensure a high level of quality.
  • Identify and fix performance bottlenecks and inefficiencies.
  • Continuously improve automation to reduce manual work.

You might thrive in this role if you have:

  • Experience managing large-scale server environments.
  • A balance of strengths in building and operationalizing.
  • Proficiency in Python, Go, or similar languages.
  • Strong Linux, networking, and server hardware knowledge.
  • Comfort digging into noisy data with SQL, PromQL, and Pandas or any other tool.

Prior hardware expertise is not required for this role.

Bonus Skills:

  • Experience with low level details of hardware components, protocols, and associated Linux tooling (e.g., PCIe, Infiniband, networking, power management, kernel perf tuning)
  • Knowledge of hardware management protocols (e.g., IPMI, Redfish).
  • High-performance computing (HPC) or distributed systems experience.
  • Prior experience developing, managing, or designing hardware.
  • Familiarity with monitoring tools (e.g., Prometheus, Grafana).

Skills

PythonGoLinuxSQLPromqlpandasPrometheusGrafanaKubernetesInfiniBand

Similar roles

DevOps / SRE jobs
OpenAI

Software Engineer, Productivity - Inference Runtime

OpenAISan Francisco, CA

Builds and improves CI/CD, testing, validation, and release tooling for OpenAI's inference runtime teams to ensure reliable, performant model deployments across ChatGPT, API, and research workloads. Requires strong Python skills, developer productivity experience, and high ownership in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Core Network Engineering

OpenAISan Francisco, CA

Builds and operates high-performance networking infrastructure for OpenAI's large-scale AI training and inference, focusing on host networking, datacenter fabrics, and WAN systems. Optimizes latency, reliability, and scalability using technologies like RDMA, InfiniBand, and RoCE; requires strong systems programming in C++, Python, or Go.

230k – 342k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Productivity - Model Performance

OpenAISan Francisco, CA

Builds and improves developer tools, CI/CD pipelines, and testing workflows to boost productivity for OpenAI's model performance engineering teams. Requires strong Python skills, experience with developer infrastructure, and ability to work in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Productivity - Networking

OpenAISan Francisco, CA

Enhances developer productivity for OpenAI's networking team by improving build systems, CI/CD pipelines, test harnesses, and workflows for C++ and Python codebases in multi-server environments. Requires experience with developer tools and infrastructure automation.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Compute Infrastructure

OpenAISan Francisco, CA +2

Builds and optimizes large-scale compute infrastructure for AI workloads, spanning hardware automation, distributed systems, Kubernetes orchestration, networking, storage, and developer tools. Requires strong systems engineering experience in performance, reliability, and production infrastructure.

230k – 405k/yr
HybridDevOps / SRE