# Director of AI Infrastructure

**Company:** [Ai2](https://hotfix.jobs/companies/ai2)
**Location:** Seattle, WA
**Role:** DevOps / SRE
**Salary:** $176k – $265k/yr
**Experience:** 12+ years
**Skills:** Linux Kernel, Kubernetes, Slurm, Nvidia Gpu, InfiniBand, Roce, Distributed Filesystems, Weka, Ceph, Lustre, Go, Python, AWS, GCP, Beaker
**Posted:** 2026-04-22

> Leads AI infrastructure including on-prem GPU clusters, hybrid cloud orchestration, storage, and resource allocation to support frontier AI research. Requires 12+ years experience with HPC leadership, GPU systems, Kubernetes, and distributed storage.

## Job Description

## Responsibilities

- Oversee the availability and performance of dense on-prem GPU clusters. Partner with hardware vendors and internal teams to ensure physical infrastructure meets demands of frontier model training.
- Direct strategy for Beaker orchestration platform. Optimize job scheduling for high utilization of on-prem assets and elastic cloud resources (AWS/GCP).
- Develop and execute long-term roadmap for storage balancing high-throughput performance for active training with cost-effective durability for petascale research data.
- Act as primary steward of GPU compute budget. Make data-driven decisions on bursting to cloud vs. investing in on-prem capacity.
- Serve as technical bridge to research teams, ensuring infrastructure accelerates diverse research objectives.

## Requirements

- 12+ years in infrastructure, systems engineering, or HPC, with at least 5 years in leadership managing multi-disciplinary engineering teams.
- Bachelor’s degree in related field; relevant advanced degree may substitute for equivalent experience.
- Direct experience managing large-scale NVIDIA GPU clusters and high-performance networking (InfiniBand/RoCE).
- Strong background in Kubernetes, Slurm, or similar orchestration frameworks in hybrid-cloud configurations.
- Experience with distributed filesystems (e.g., WEKA, Ceph, Lustre) and cloud storage integration at scale.
- Proficient in Go or Python, with ability to review architecture and code for internal tooling.

**Compensation:** Base salary $176,400 - $264,600 plus generous bonus plans.

## Similar roles

- [Director of SRE (FTE)](https://hotfix.jobs/jobs/70c68bc7-0427-46cb-a55f-d74b0d9ba4f9) - IntusCare - Remote - $175k – $200k/yr
- [Platform Staff Engineer- Universal Directory](https://hotfix.jobs/jobs/c9e05e2d-ab96-4d51-95b7-8e41fc58babd) - Okta - San Francisco, CA - $194k – $243k/yr
- [Director of Site Reliability Engineering](https://hotfix.jobs/jobs/5ae870ad-7e92-4e0a-ae73-7e0de85940f0) - Stellar - New York, NY - $210k – $310k/yr
- [Director of Platform & Reliability Engineering](https://hotfix.jobs/jobs/531f73c7-304c-40b2-a78d-ace7273cf276) - Forge - San Francisco, CA - $235k – $245k/yr
- [Director, Data Center Operations](https://hotfix.jobs/jobs/b5a99ae6-c850-4661-832c-daaae6d10d25) - Together AI - San Francisco, CA - $250k – $300k/yr

**Apply:** https://hotfix.jobs/jobs/04e76a05-fdae-452f-bb6a-9ef92e0b5ae1
**Canonical:** https://hotfix.jobs/jobs/04e76a05-fdae-452f-bb6a-9ef92e0b5ae1