Skip to content
Cerebras SystemsCerebras SystemsSunnyvale, CA

Principal Engineer, Inference Cloud

Principal Engineer leads Inference Cloud Platform, defining architecture for multi-region, high-QPS AI inference systems. Focuses on reliability, performance optimization, production code, and cross-team technical strategy. Requires 10+ years in distributed systems.

Salary not listed
On-site10+ YOEDevOps / SRE

About the role

Responsibilities

  • Problem Definition & Prioritization: Identify the most important technical problems for the platform, make explicit tradeoff decisions.

  • Platform Direction: Set long-term technical direction including multi-region topology, failure domains, service boundaries, and system evolution.

  • Reliability & Performance: Architect active-active systems with rapid failover, graceful degradation (circuit breaking, backpressure, load shedding), SLOs; improve latency, throughput, capacity efficiency, resilience.

  • Code & Design Reviews: Contribute production code in critical paths, review designs and implementations, make architectural decisions including build-vs-buy.

  • Production Leadership: Lead on production issues, cross-system bottlenecks; drive observability, incident response, capacity planning, post-incident improvements.

  • Technical Strategy Beyond Your Team: Drive platform-wide decisions on reliability, API design, capacity planning, deployment strategy; translate product/business requirements into scalable designs.

  • Mentorship: Raise technical decision-making quality through design feedback, pairing, engineering standards.

Skills & Qualifications

  • 10+ years software engineering experience building/operating large-scale distributed systems or cloud infrastructure.

  • Deep expertise in distributed systems architecture: networking, compute orchestration, container platforms, multi-region services.

  • Track record of architectural decisions for highly available, latency-sensitive systems at scale.

  • Experience optimizing latency, throughput, efficiency in high-QPS systems (TTFT, tail-latency a plus).

  • Proficiency in Go, C++, or Python for production code.

  • Designing observability/reliability: metrics, logging, tracing, alerting, incident response, SLI/SLO/SLA.

  • Influence senior engineers/cross-functional partners via credibility, communication, judgment.

  • ML inference infrastructure, model serving, GPU workloads (plus).

Skills

Distributed SystemsGoC++PythonKubernetesMulti-Region ArchitectureObservabilitySlo/SliLatency OptimizationHigh-Qps SystemsMl InferenceCircuit BreakingLoad SheddingIncident ResponseCapacity Planning

Similar roles

DevOps / SRE jobs
Cerebras Systems

Principal Site Reliability Engineer

Cerebras SystemsSunnyvale, CA

Principal SRE to architect self-service reliability platforms, capacity orchestration, and production control planes for Cerebras' ultra-high-speed AI inference infrastructure at massive scale. Requires 15+ years in SRE/platform engineering with deep large-scale fleet and observability experience.

Salary not listed
On-site15+ YOEDevOps / SRE
Cloudflare

Principal Software Engineer: Distributed Systems

CloudflareSan Francisco, CA +2

Principal IC owning technical coherence of Cloudflare's Intent Management platform for safe, health-mediated configuration changes and deployments across global distributed storage, progressive releases, and testing systems. Requires 10+ years experience leading large-scale distributed systems initiatives, strong technical leadership, LLM integration, and expertise in at least one modern strongly-typed language.

200k – 288k/yr
Hybrid10+ YOEDevOps / SRE
Fluidstack

Principal Operations Engineer, Reliability

FluidstackUnited States

Principal Operations Engineer owning reliability for Fluidstack's nation-scale data center fleet. Lead RCAs, drive corrective actions to eliminate failure classes, conduct site audits and travel (50%+), standardize best practices across campuses while operating in active construction zones.

150k – 250k/yr
Remote7+ YOEDevOps / SRE
Fluidstack

Principal Operations Engineer, Hardware

FluidstackUnited States

Principal technical authority for operational hardware fleet across hyperscale AI data centers. Lead site assessments, audits, root cause investigations, and drive operational readiness for GPU/server infrastructure at scale.

150k – 250k/yr
Remote10+ YOEDevOps / SRE
Onebrief

Principal Infrastructure Engineer

OnebriefUnited States

Principal Infrastructure Engineer building and operating secure cloud-native and edge platforms for military collaboration software. Requires 8+ years production infrastructure experience, deep Kubernetes expertise, and ability to obtain SECRET clearance.

235k – 275k/yr
Remote8+ YOEDevOps / SRE