# Principal Site Reliability Engineer

**Company:** [Cerebras Systems](https://hotfix.jobs/companies/cerebras-systems)
**Location:** Sunnyvale, CA
**Role:** DevOps / SRE
**Experience:** 15+ years
**Skills:** SRE, Infrastructure Engineering, Platform Engineering, Observability, SLOs, Slis, Capacity Management, Orchestration Systems, Schedulers, Control Planes, Chaos Testing, Bazel, Ai/Ml Inference, Gpu Orchestration
**Posted:** 2026-07-06

> Principal SRE to architect self-service reliability platforms, capacity orchestration, and production control planes for Cerebras' ultra-high-speed AI inference infrastructure at massive scale. Requires 15+ years in SRE/platform engineering with deep large-scale fleet and observability experience.

## Job Description

## Key Responsibilities
- Define and implement a robust strategy for delivering and running software reliably and at scale across multiple datacenters and cloud-based solutions.
- Architect self-service platforms and internal tooling that let product teams, external customers, and cluster operators safely trigger and observe critical workflows with minimal handoffs.
- Define and evolve reliability practices for inference workloads, including SLOs and SLIs for latency, throughput, and accuracy stability; error budgets; blameless postmortems; chaos testing; and capacity forecasting across multi-datacenter and on-prem environments.
- Mentor senior SREs, support critical incident escalations, and use production pain points to prioritize the highest-leverage automation work.
- Measure and drive impact through clear metrics, including toil reduction, deployment velocity, SLO compliance, MTTR, and adoption of self-service workflows.

## Required Experience & Skills
- 15+ years in SRE, infrastructure engineering, or platform engineering, with a record of setting technical direction and delivering reliability improvements at large scale in FAANG, hyperscaler, frontier AI, or similarly demanding production environments.
- Deep experience with large-scale compute fleets, internal control planes, schedulers, orchestration systems, capacity management, and reliability automation.
- Experience defining and driving cross-team architecture for production control planes, capacity orchestration, fleet management, or self-service infrastructure platforms with clear operational ownership.
- Strong judgment in converging fragmented workflows, tools, and teams into coherent architectures that improve reliability, efficiency, and operational leverage.
- Ability to lead complex, ambiguous technical programs end to end; influence senior cross-functional stakeholders; mentor senior engineers; and communicate technical strategy clearly.
- Hands-on experience with production observability, incident response, and SLO-based reliability management across metrics, logs, traces, alerting, dashboards, and operational review loops.

## Nice-to-Haves
- Experience with Bazel or other large-scale build systems in production.
- Background in AI/ML inference systems, including model serving runtimes, disaggregated inference, GPU orchestration, latency and accuracy SLOs, or drift monitoring.
- Prior work on predictive autoscaling, chaos engineering, or cost-aware capacity management for compute-intensive workloads.

## Similar roles

- [Principal Software Engineer: Distributed Systems](https://hotfix.jobs/jobs/75b2c78b-ae6c-4728-8077-52b685fd1a6d) - Cloudflare - San Francisco, CA - $200k – $288k/yr
- [Principal Operations Engineer, Reliability](https://hotfix.jobs/jobs/e71cb5d2-1eaa-4508-805a-da2963d7fa58) - Fluidstack - Remote - $150k – $250k/yr
- [Principal Operations Engineer, Hardware](https://hotfix.jobs/jobs/f1c077a0-a07d-4ff6-b0c1-bc1e2e991431) - Fluidstack - Remote - $150k – $250k/yr
- [Principal Infrastructure Engineer](https://hotfix.jobs/jobs/0702927c-1489-4897-83b4-9ee80a871baa) - Onebrief - Remote - $235k – $275k/yr
- [Principal Operations Engineer, Mechanical](https://hotfix.jobs/jobs/1033a3a6-548c-4699-8e58-e9cb70cf32cd) - Fluidstack - Remote - $150k – $250k/yr

**Apply:** https://hotfix.jobs/jobs/4f596c32-2454-4006-81d2-0357ebd1b86d
**Canonical:** https://hotfix.jobs/jobs/4f596c32-2454-4006-81d2-0357ebd1b86d