Skip to content
FluidstackFluidstackSan Francisco, CA

Principal Incident Responder

Lead material incident response as the most senior commander. Build and run the full IR program including runbooks, on-call processes, agent-human coordination, and cross-functional remediation for AI infrastructure.

270k – 370k/yr
On-siteSecurity Engineering

About the role

Responsibilities

  • Run material incidents as incident commander, coordinating across detection, response, physical security, data center operations, legal, communications, and customers.
  • Build the IR program: runbook standards, severity definitions, materiality methodology, evidence contracts, and post-incident review cadence.
  • Define the agent-human contract for response: escalation criteria, evidence packages required from agents, and human verdict feedback into agent quality.
  • Design and operate the senior-IR on-call rotation (ack SLAs, escalation chain, fan-out logic) and remain an active senior IC inside it.
  • Analyze incident trends and patterns to surface systemic risks and recurring root causes, and turn the learnings into runbook, detection, or program improvements.
  • Drive cross-functional follow-through after every significant incident, tracking remediation and systemic fixes to completion across detection, response, infrastructure, and other teams.
  • Define and track the IR program’s KPIs and report on them to security and engineering leadership.
  • Set the tabletop and exercise cadence for IR readiness, executive crisis-comms, and audit-readiness drills.
  • Carry the external face of IR for regulatory and customer disclosure obligations, and audit responses.

Requirements

  • Run material incidents at companies with sophisticated threat models, as the most senior commander on the call.
  • Made disclosure-grade calls under regulatory and customer reporting clocks.
  • Written runbooks that other engineers followed under pressure, and rewritten them after they did not work.
  • Built operational processes from the ground up in environments where structure did not previously exist.
  • Move fluently between technical containment and executive, legal, or customer-facing conversations during a declared incident.
  • See what is needed, scope it yourself, and run with it.

Skills

Incident ResponseRunbook DevelopmentSecurity OperationsThreat ModelingOn-Call Rotation ManagementRoot Cause AnalysisKPI TrackingTabletop ExercisesRegulatory DisclosureOt/Ics Security
Databricks

Principal Engineer, Authentication

DatabricksBellevue, WA +1

Principal Engineer leads Authentication strategy at Databricks, crafting secure, scalable systems with 10+ years in data security, 15+ in distributed systems, and MS/PhD required. Mentors teams and drives executive decisions.

266k – 366k/yr
Remote10+ YOESecurity Engineering
Crusoe

Principal Network Architect

CrusoeSan Francisco, CA +2

Principal-level individual contributor defining and owning network architecture strategy across Crusoe's AI infrastructure stack, from data center fabrics and RDMA to SDN, Kubernetes networking, and automation. Requires 12+ years experience with expert-level routing, SDN, and large-scale data center design.

265k – 310k/yr
On-site12+ YOESecurity Engineering
Snowflake

Principal Engineer, Identity Data Security and Trust

SnowflakeMenlo Park, CA

Leads architecture and strategy for Data Exfiltration Protection (DXP) and Data Movement Policy (DMP) systems. Bridges security policy with scalable enforcement in multi-cloud environments, requiring 12+ years experience in distributed systems and security expertise.

264k – 380k/yr
On-site12+ YOESecurity Engineering
OpenAI

Principal Security Engineer, Infrastructure Security

OpenAISan Francisco, CA +3

Leads architecture and implementation of planet-scale security services like authN/Z, proxies, and key management for OpenAI's GPU clusters, multi-cloud infra, and AI models. Requires expertise in secure distributed systems, cloud platforms, and cross-team leadership.

278k – 490k/yr
RemoteSecurity Engineering
OpenAI

Principal Security Engineer, Infrastructure Security

OpenAISan Francisco, CA +3

Principal Security Engineer leads security for OpenAI's infrastructure including GPU clusters, multi-cloud, datacenters, and Kubernetes. Drives strategy, builds controls against advanced threats, and mentors teams with deep cloud and on-prem expertise.

278k – 490k/yr
RemoteSecurity Engineering