# Site Reliability Engineer - AI & ML Infrastructure (Kubernetes, AWS & Terraform)

**Company:** [Deepgram](https://hotfix.jobs/companies/deepgram)
**Location:** Remote
**Role:** DevOps / SRE
**Salary:** $150k – $220k/yr
**Experience:** 5+ years
**Skills:** Kubernetes, Terraform, AWS, Slurm, Python, Go, Bash, Cni, Csi, S3
**Posted:** 2026-03-09

> Builds and operates hybrid AI/ML infrastructure using Kubernetes, AWS, Terraform, and Slurm for GPU workloads. Requires 5+ years SRE/DevOps experience, expert Kubernetes, and bare metal management.

## Job Description

## Opportunity
Experienced Site Reliability Engineer to build and operate hybrid infrastructure for AI/ML research and product development. Architect, build, and run platform spanning AWS and bare metal data centers using Kubernetes, AWS, and Terraform, orchestrating GPU workloads with Slurm.

## What You’ll Do
- Architect and maintain core computing platform using Kubernetes on AWS and on-premise.
- Develop and manage infrastructure using Infrastructure-as-Code with **Terraform**.
- Design, build, and optimize AI/ML job scheduling with **Slurm** integrated with Kubernetes for GPU resources.
- Provision, manage, and maintain on-premise bare metal server infrastructure for GPU computing.
- Implement platform's networking (**CNI**, service mesh) and storage (**CSI**, **S3**) solutions.
- Develop observability stack (monitoring, logging, tracing) and automation for operations.
- Collaborate with AI researchers and ML engineers to build tools and workflows.

## You’ll Love This Role If You
- Passionate about building platforms for developers and researchers.
- Enjoy automated solutions for complex infrastructure in cloud and data centers.
- Thrive on optimizing hybrid infrastructure for performance, cost, and reliability.
- Excited about platform engineering and AI intersection.

## It’s Important To Us That You Have
- **5+ years** in Platform Engineering, **DevOps**, or **SRE**.
- Hands-on experience with **Terraform** in production.
- Expert-level **Kubernetes** architecture and operations.
- Experience with **Slurm** for GPU-intensive AI workloads.
- Managing bare metal infrastructure (PXE boot, MAAS).
- Strong scripting (**Python**, **Go**, **Bash**).

## It Would Be Great if You Had
- Experience with **CI/CD** (**GitLab CI**, **Jenkins**, **ArgoCD**).
- **FinOps** and cloud cost optimization.
- **Kubernetes** networking (**Calico**, **Cilium**) and storage (**Ceph**, **Rook**).
- Multi-region or hybrid cloud experience.

## Similar roles

- [Site Reliability Engineer](https://hotfix.jobs/jobs/31ec0a81-7790-4ee1-94de-5729935ed7e5) - Runpod - Remote - $150k – $200k/yr
- [DevSecOps Engineer](https://hotfix.jobs/jobs/67398973-784d-4b66-ab52-901744181150) - Turion Space - Irvine, CA - $150k – $213k/yr
- [Software Engineer](https://hotfix.jobs/jobs/ba2266bc-5c0a-4708-b7d4-e006c9fec0cd) - Clear Street - New York, NY - $150k – $200k/yr
- [Software Engineer - Networking Software and Services](https://hotfix.jobs/jobs/dfd4fd59-1833-486f-afa8-b4c6f924d0ab) - xAI - Palo Alto, CA - $150k – $250k/yr
- [Software Engineer, Platform](https://hotfix.jobs/jobs/c634339f-84c8-497a-bf18-8e15f507bef9) - Rillet - New York, NY - $150k – $270k/yr

**Apply:** https://hotfix.jobs/jobs/48ce9884-015c-4085-88be-f4c1b9ba752a
**Canonical:** https://hotfix.jobs/jobs/48ce9884-015c-4085-88be-f4c1b9ba752a