# Senior Site Reliability Engineer, Platform Infrastructure

**Company:** [Anyscale](https://hotfix.jobs/companies/anyscale)
**Location:** San Francisco, CA, Palo Alto, CA, California
**Role:** DevOps / SRE
**Experience:** 3+ years
**Skills:** Kubernetes, AWS, Azure, GCP, Go, Python, Prometheus, Grafana, Linux, Containers
**Posted:** 2026-06-17

> Senior SRE building and scaling control and data plane infrastructure for distributed AI/ML workloads on Ray. Requires 3+ years production experience, strong distributed systems background, Kubernetes, cloud platforms, Go/Python, and observability expertise.

## Job Description

## Responsibilities
- Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, supporting both VM-based and Kubernetes-based deployments
- Optimize control plane components for large-scale, distributed AI/ML workloads
- Build intelligent scheduling and resource management systems for heterogeneous compute clusters
- Develop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
- Support and optimize accelerator integration (e.g., GPUs, TPUs)
- Handle container image management and dependency resolution for distributed workloads
- Participate in code reviews, design and architecture discussions
- Provide on-call support, working closely with customer and field teams to troubleshoot infrastructure issues
- Collaborate with leading distributed systems and machine learning experts to push the boundaries of AI infrastructure

## Requirements
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
- 3+ years of experience writing high-quality production code
- Hands-on experience in building and maintaining highly available, scalable, and performant distributed systems
- Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments
- Deep understanding of networking, security, and authentication mechanisms in cloud environments
- Familiarity with observability stacks (Prometheus, Grafana, etc.)
- Proficiency in Go and Python
- Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)

## Similar roles

- [Site Reliability Engineer](https://hotfix.jobs/jobs/ab64f10b-7c19-4c49-b827-0e3559c514c9) - Forward Networks - Santa Clara, CA - $230k – $250k/yr
- [Sr. Software Engineer, Platform Engineering](https://hotfix.jobs/jobs/fafdb79e-697e-4378-aa19-4482d0884fe1) - Chronograph - Remote - $175k – $215k/yr
- [Senior Site Reliability Engineer](https://hotfix.jobs/jobs/076df34d-0d8e-4f15-8a79-eb559a8e5f52) - Talkiatry - Remote - $160k – $185k/yr
- [Senior Infrastructure Engineer](https://hotfix.jobs/jobs/7fad3112-9910-402c-b20e-17b838f39c55) - Aurelian - Seattle, WA - $160k – $220k/yr
- [Sr. Site Reliability Engineer](https://hotfix.jobs/jobs/2c837b9b-f230-4e2a-aadb-21d12039b4d2) - Illumio - Sunnyvale, CA - $170k – $196k/yr

**Apply:** https://hotfix.jobs/jobs/4501ca74-99c6-494f-93a1-0184fd51bfa5
**Canonical:** https://hotfix.jobs/jobs/4501ca74-99c6-494f-93a1-0184fd51bfa5