Skip to content
CloudflareCloudflareSan Francisco, CA

Principal Software Engineer: Distributed Systems

Principal IC owning technical coherence of Cloudflare's Intent Management platform for safe, health-mediated configuration changes and deployments across global distributed storage, progressive releases, and testing systems. Requires 10+ years experience leading large-scale distributed systems initiatives, strong technical leadership, LLM integration, and expertise in at least one modern strongly-typed language.

200k – 288k
Hybrid10+ YOEDevOps / SRE

About the role

What you'll do

Too many of Cloudflare's most impactful incidents have had unsafe change as a root cause. The Intent Management exists to make safe change the easy button and this is the most senior IC role in that organization, reporting directly to the Senior Director. You will own the technical coherence of a platform that spans globally distributed key-value storage, progressive release and configuration delivery, and the testing and health-mediation systems that prove change is safe. You'll work at the seams that matter most by translating what Cloudflare's Edge and control-plane platforms need into the primitives our teams build. You'll move fluidly between writing production code, designing new systems, and reviewing the proposals of other senior engineers. You’ll also help us work out how best to integrate LLMs into our processes and systems.

You will be working alongside engineers who have presented at DevOps Days, Config Management Camp 2024 & 2025, Monitorama, OSMC, KubeCon and PromCon. Together you will deliver on the key Health Mediated Deployment projects that are being tracked through senior leadership of Cloudflare up to the founders.

Requirements

  • 10+ years of software engineering experience with a demonstrated history of leading complex, organization-wide technical initiatives that delivered measurable improvements to system performance, reliability, security, developer productivity, or engineering culture.
  • Strong track record of technical leadership and influence without direct authority, including driving consensus on technical decisions across multiple teams, mentoring senior engineers, and establishing architectural patterns that are widely adopted across an organization.
  • Experience designing, building and managing high volume, global scale software applications.
  • Expert in at least one modern strongly-typed programming language.
  • Knowledge of API design standards, patterns and best practices.
  • Experience working with top tier LLMs to plan, write, test, and deploy software.

Nice-to-haves

  • Strong interpersonal and communication skills with a bias towards action.
  • Experience with scaling and simplifying high scale Configuration Management systems.
  • Familiarity with Google’s Prodspec and Annealing systems.
  • Experience with Kubernetes.
  • Experience with RocksDB or similar data stores.
  • Experience with health checking and probe platforms at significant scale.
  • Public evidence of technical leadership such as conference talks on distributed systems or security, widely-read technical blog posts, significant open source contributions, or published architectural patterns that have been adopted by the broader engineering community.

Compensation

For Bay Area based hires: Estimated annual salary of $230,000 - $288,000.
For Washington and New York City based hires: Estimated annual salary of $220,000 - $275,000.
For Austin based hires: Estimated annual salary of $200,000 - $250,000.

This role is eligible to participate in Cloudflare’s equity plan.

Skills

Distributed SystemsConfiguration ManagementKubernetesRocksdbLlm IntegrationAPI DesignStrongly Typed LanguagesHealth CheckingProbe PlatformsGlobal Scale Applications

Similar roles

DevOps / SRE jobs
Okta

Principal Classified Systems Architect, Okta Federal

OktaWashington, DC

Leads architecture of air-gapped classified (SIPR/JWICS) developer platforms for DoD compliance, designs IaC for disconnected ops, integrates hardened tools like Big Bang/Iron Bank, and ensures secure, scalable Kubernetes infrastructure. Requires 12+ years experience with 5+ in classified DoD environments.

224k – 308k
On-site12+ YOEDevOps / SRE
Cerebras Systems

Design Validation Test - Lead/Principal Engineer

Cerebras SystemsSunnyvale, CA

Leads end-to-end Design Validation Test (DVT) for complex electrical boards and systems, including power delivery, high-speed I/O validation, debug, and root-cause analysis. Requires 8+ years experience in hardware validation, strong EE skills, and lab equipment proficiency.

175k – 275k
On-site8+ YOEDevOps / SRE
Onebrief

Principal Infrastructure Engineer

OnebriefUnited States

Principal Infrastructure Engineer building and operating secure cloud-native and edge platforms for military collaboration software. Requires 8+ years production infrastructure experience, deep Kubernetes expertise, and ability to obtain SECRET clearance.

235k – 275k
Remote8+ YOEDevOps / SRE
Fluidstack

Principal Operations Engineer, Reliability

FluidstackUnited States

Principal Operations Engineer owning reliability for Fluidstack's nation-scale data center fleet. Lead RCAs, drive corrective actions to eliminate failure classes, conduct site audits and travel (50%+), standardize best practices across campuses while operating in active construction zones.

150k – 250k
Remote7+ YOEDevOps / SRE
Fluidstack

Principal Operations Engineer, Hardware

FluidstackUnited States

Principal technical authority for operational hardware fleet across hyperscale AI data centers. Lead site assessments, audits, root cause investigations, and drive operational readiness for GPU/server infrastructure at scale.

150k – 250k
Remote10+ YOEDevOps / SRE