Site Reliability Engineer - AI & ML Infrastructure (Kubernetes, AWS & Terraform)

Opportunity

Experienced Site Reliability Engineer to build and operate hybrid infrastructure for AI/ML research and product development. Architect, build, and run platform spanning AWS and bare metal data centers using Kubernetes, AWS, and Terraform, orchestrating GPU workloads with Slurm.

What You’ll Do

• Architect and maintain core computing platform using Kubernetes on AWS and on-premise.
• Develop and manage infrastructure using Infrastructure-as-Code with Terraform.
• Design, build, and optimize AI/ML job scheduling with Slurm integrated with Kubernetes for GPU resources.
• Provision, manage, and maintain on-premise bare metal server infrastructure for GPU computing.
• Implement platform's networking (CNI, service mesh) and storage (CSI, S3) solutions.
• Develop observability stack (monitoring, logging, tracing) and automation for operations.
• Collaborate with AI researchers and ML engineers to build tools and workflows.

You’ll Love This Role If You

• Passionate about building platforms for developers and researchers.
• Enjoy automated solutions for complex infrastructure in cloud and data centers.
• Thrive on optimizing hybrid infrastructure for performance, cost, and reliability.
• Excited about platform engineering and AI intersection.

It’s Important To Us That You Have

• 5+ years in Platform Engineering, DevOps, or SRE.
• Hands-on experience with Terraform in production.
• Expert-level Kubernetes architecture and operations.
• Experience with Slurm for GPU-intensive AI workloads.
• Managing bare metal infrastructure (PXE boot, MAAS).
• Strong scripting (Python, Go, Bash).

It Would Be Great if You Had

• Experience with CI/CD (GitLab CI, Jenkins, ArgoCD).
• FinOps and cloud cost optimization.
• Kubernetes networking (Calico, Cilium) and storage (Ceph, Rook).
• Multi-region or hybrid cloud experience.