Skip to content
Ai2Ai2Seattle, WA

Director of AI Infrastructure

Leads AI infrastructure including on-prem GPU clusters, hybrid cloud orchestration, storage, and resource allocation to support frontier AI research. Requires 12+ years experience with HPC leadership, GPU systems, Kubernetes, and distributed storage.

176k – 265k/yr
On-site12+ YOEDevOps / SRE

About the role

Responsibilities

  • Oversee the availability and performance of dense on-prem GPU clusters. Partner with hardware vendors and internal teams to ensure physical infrastructure meets demands of frontier model training.
  • Direct strategy for Beaker orchestration platform. Optimize job scheduling for high utilization of on-prem assets and elastic cloud resources (AWS/GCP).
  • Develop and execute long-term roadmap for storage balancing high-throughput performance for active training with cost-effective durability for petascale research data.
  • Act as primary steward of GPU compute budget. Make data-driven decisions on bursting to cloud vs. investing in on-prem capacity.
  • Serve as technical bridge to research teams, ensuring infrastructure accelerates diverse research objectives.

Requirements

  • 12+ years in infrastructure, systems engineering, or HPC, with at least 5 years in leadership managing multi-disciplinary engineering teams.
  • Bachelor’s degree in related field; relevant advanced degree may substitute for equivalent experience.
  • Direct experience managing large-scale NVIDIA GPU clusters and high-performance networking (InfiniBand/RoCE).
  • Strong background in Kubernetes, Slurm, or similar orchestration frameworks in hybrid-cloud configurations.
  • Experience with distributed filesystems (e.g., WEKA, Ceph, Lustre) and cloud storage integration at scale.
  • Proficient in Go or Python, with ability to review architecture and code for internal tooling.

Compensation: Base salary $176,400 - $264,600 plus generous bonus plans.

Skills

Linux KernelKubernetesSlurmNvidia GpuInfiniBandRoceDistributed FilesystemsWekaCephLustreGoPythonAWSGCPBeaker

Similar roles

DevOps / SRE jobs
IntusCare

Director of SRE (FTE)

IntusCareUnited States

Leads SRE strategy, reliability, observability, incident management, and QA for cloud-native healthcare EMR platform. Oversees Azure AKS, Kubernetes, CI/CD, and vendor teams; requires 12+ years SRE experience with 5+ years leadership.

175k – 200k/yr
Remote12+ YOEDevOps / SRE
Okta

Platform Staff Engineer- Universal Directory

OktaSan Francisco, CA

Staff engineer on Universal Directory Platform team builds scalable distributed systems for identity management using Java and cloud infrastructure. Requires 7+ years Java experience, expertise in Spring Boot/Hibernate, and 3+ years deploying services on AWS/GCP.

194k – 243k/yr
Hybrid7+ YOEDevOps / SRE
Stellar

Director of Site Reliability Engineering

StellarNew York, NY +1

Lead and develop a distributed SRE team, setting vision and operating model for reliability practices. Own core infrastructure services (Kubernetes, CI/CD, observability) and drive service ownership frameworks across engineering teams.

210k – 310k/yr
Hybrid10+ YOEDevOps / SRE
Forge

Director of Platform & Reliability Engineering

ForgeSan Francisco, CA

The Director of Platform & Reliability Engineering will lead an engineering organization responsible for secure, scalable, and highly reliable products. This role involves setting the vision for internal platforms, cloud infrastructure, developer enablement, and production operations.

235k – 245k/yr
Hybrid8+ YOEDevOps / SRE
Together AI

Director, Data Center Operations

Together AISan Francisco, CA

Lead design, fit-out, and commissioning of data center sites focused on power, cooling, and IT infrastructure for high-density GPU workloads. Build and manage a 20-person operations team, oversee multi-site portfolio, and establish processes from scratch.

250k – 300k/yr
On-siteDevOps / SRE