# Software Engineer, Fleet Hardware Health

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** Hardware Engineering
**Salary:** $230k – $490k/yr
**Skills:** Python, Go, Linux, SQL, Promql, pandas, Prometheus, Grafana, Kubernetes, Ipmi, Redfish, Pcie, InfiniBand
**Posted:** 2025-07-15

> Develops automation and monitoring tools to ensure reliability and uptime of OpenAI's large-scale compute fleet, including server provisioning, health monitoring, and performance optimization. Requires strong Linux, networking, and programming skills in Python or Go, with experience in large-scale server environments.

## Job Description

## Responsibilities
- Build and maintain automation systems for provisioning and managing server fleets.
- Develop tools to monitor server health, performance, and lifecycle events.
- Collaborate with clusters, networking, and infrastructure teams.
- Partner with external operators to ensure a high level of quality.
- Identify and fix performance bottlenecks and inefficiencies.
- Continuously improve automation to reduce manual work.

## Requirements
- Experience managing large-scale server environments.
- A balance of strengths in building and operationalizing.
- Proficiency in **Python**, **Go**, or similar languages.
- Strong **Linux**, **networking**, and server hardware knowledge.
- Comfort digging into noisy data with **SQL**, **PromQL**, and **Pandas** or any other tool.

## Bonus Skills
- Experience with low level details of hardware components, protocols, and associated Linux tooling (e.g., **PCIe**, **Infiniband**, **networking**, power management, kernel perf tuning).
- Knowledge of hardware management protocols (e.g., **IPMI**, **Redfish**).
- High-performance computing (**HPC**) or distributed systems experience.
- Prior experience developing, managing, or designing hardware.
- Familiarity with monitoring tools (e.g., **Prometheus**, **Grafana**).

## Similar roles

- [Prototyping Lab Technician, Robotics](https://hotfix.jobs/jobs/dbcc6603-0989-4a27-9fbc-972420c6f732) - OpenAI - San Francisco, CA - $225k – $295k/yr
- [Software Engineer, Hardware](https://hotfix.jobs/jobs/1f98b086-e1fb-44ce-8531-1a3413b0b9b6) - OpenAI - San Francisco, CA - $225k – $455k/yr
- [Robotics Engineer](https://hotfix.jobs/jobs/2fec06ad-dd6e-401d-81e0-ae19932be4d4) - Luma AI - Los Angeles, CA - $250k – $450k/yr
- [Electrical Engineer, Deployment Engineering](https://hotfix.jobs/jobs/4901b7d4-bc34-4cc0-948b-f4e588da13cd) - Fluidstack - Austin, TX - $200k – $250k/yr
- [Mechanical Engineer, Deployment Engineering](https://hotfix.jobs/jobs/58481778-0ce3-46dc-9ff0-8db996113150) - Fluidstack - Austin, TX - $200k – $250k/yr

**Apply:** https://hotfix.jobs/jobs/e31d3d94-81ab-4143-b3bf-d09dba766ab8
**Canonical:** https://hotfix.jobs/jobs/e31d3d94-81ab-4143-b3bf-d09dba766ab8