Skip to content
SfcomputeSfcomputeSan Francisco, CA

HPC/ GPU Cluster Architect

Designs, architects, and scales production GPU/HPC clusters globally. Debugs hardware/software issues, automates operations, and mentors juniors. Requires 5+ years experience and hybrid SF presence.

220k – 300k/yr
Hybrid5+ YOEDevOps / SRE

About the role

Responsibilities

  • Architect and deploy new GPU/HPC clusters around the world
  • Keep clusters running smoothly
  • Participate in on-call rotation
  • Deploy new environments and fix issues
  • Lean into automation for deployments at scale
  • Mentor junior engineers and shape team culture

Requirements

  • 5+ years experience designing, architecting, and scaling HPC or GPU compute clusters in production
  • Deep understanding of server hardware: GPUs, NICs, PCIe, memory, thermals, power
  • Comfortable debugging performance/reliability across hardware, OS, drivers, networking
  • Automate fleet operations (provisioning, monitoring, remediation) with infrastructure-as-code
  • Generate strong operational documentation and runbooks
  • Open to SF office 3-4 days/week and domestic travel

Nice to Haves

  • Data center operations: power, cooling, colo/vendor engagements
  • Strong Linux sysadmin: kernel drivers, RDMA tuning, performance analysis
  • Schedulers/orchestration: Slurm, Kubernetes
  • Virtualization: KVM, QEMU, libvirt
  • Telemetry for predictive hardware failure
  • High-speed fabrics: InfiniBand, RoCEv2 Ethernet

Skills

GPUHpcKubernetesSlurmInfiniBandRdmaLinuxPcieInfrastructure As CodeKvm

Similar roles

DevOps / SRE jobs
Rilla

Software Engineer, Platform

RillaNew York, NY

Builds and owns platform infrastructure from scratch including CI/CD, Terraform, AWS services, monitoring, SSO, and APIs for a scaling sales coaching startup. Requires deep experience in cloud infra, IaC, containers, databases, and observability.

220k – 300k/yr
On-siteDevOps / SRE
Perplexity

AI Infra Engineer

PerplexitySan Francisco, CA +1

Builds, deploys, and optimizes large-scale Kubernetes and Slurm clusters for AI training and inference. Requires 3+ years in ML infrastructure, expert Kubernetes/Slurm admin, Python/C++, and PyTorch experience.

220k – 405k/yr
On-site3+ YOEDevOps / SRE
Scale AI

Infrastructure Software Engineer, Enterprise GenAI

Scale AISan Francisco, CA +2

Build and scale enterprise GenAI infrastructure across multi-cloud providers (AWS, Azure, GCP), implementing integrations and architecting systems for regulated industries. Requires 4+ years experience, proficiency in Python/JS/SQL, Kubernetes, and AI technologies like LLMs.

216k – 270k/yr
On-site4+ YOEDevOps / SRE
OpenRouter

Software Engineer, Platform

OpenRouterUnited States

Owns and scales platform infrastructure including edge/cloud services on Cloudflare, GCP, Vercel and data layers like Spanner, ClickHouse, Postgres to serve millions of LLM requests daily. Requires 5+ years in production infrastructure with cloud platforms, databases, and full-stack TypeScript expertise.

215k – 285k/yr
Remote5+ YOEDevOps / SRE
OpenAI

Software Engineer, Productivity - Inference Runtime

OpenAISan Francisco, CA

Builds and improves CI/CD, testing, validation, and release tooling for OpenAI's inference runtime teams to ensure reliable, performant model deployments across ChatGPT, API, and research workloads. Requires strong Python skills, developer productivity experience, and high ownership in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE