Senior Risk & Compliance Engineer building automated signal ingestion pipelines, probabilistic risk models, and data-driven dashboards to quantify security exposure and inform executive decisions at Instacart. Requires 5+ years data engineering with Python/SQL and 3+ years deploying ML/probabilistic models in production.
156k – 230k/yr
Remote5+ YOEData Engineering
About the role
Responsibilities
Build automated signal ingestion pipelines that pull real-time data from security tooling — normalizing, enriching, and scoring raw findings into actionable, ranked risk intelligence that drives remediation decisions across the organization.
Develop probabilistic risk models that express security exposure as probability distributions, giving leadership a quantified, confidence-backed view of breach likelihood and expected losses — connecting model outputs directly to investment decisions and board-level reporting.
Identify systemic choke points across the attack surface — high-leverage remediation paths where a single fix eliminates risk at scale — and prioritize them by expected impact to maximize the efficiency of our security program.
Build dashboards and data-driven insights that cascade risk visibility across security, engineering, and executive stakeholders, translating complex model outputs into language that resonates at every level of the organization.
Support risk quantification efforts that express security exposure in financial terms, connecting model outputs to investment decisions and board-level reporting.
Requirements
5+ years of experience in data engineering, with demonstrated ability to write production-level code in Python and SQL (PostgreSQL, Presto, or SparkSQL).
3+ years of experience building and deploying machine learning or probabilistic models (e.g., Bayesian models) in a production environment.
Experience building data pipelines that ingest real-time or near-real-time data across multiple formats, handling both stream and batch processing at scale.
Experience with data modeling for classification, normalization, and risk or anomaly detection signal development.
Experience developing metrics that inform security and business decisions.
Nice-to-Haves
Familiarity with security risk concepts including threat intelligence enrichment pipelines, EPSS, or CISA KEV.
Familiarity with quantitative risk frameworks such as FAIR.
Exposure to security frameworks such as NIST CSF, SOC 2 as context for what controls the data is measuring.
Demonstrated ability to translate risk model outputs into executive or board-level narratives.
A genuine passion for building systems that protect customers and products, and a track record of operating effectively in fast-paced, ambiguous environments where the program is still being shaped.
Lead the evolution of mental health services data schema, curation pipeline, and operations for a digital marketplace platform. Direct specialists, own data quality KPIs, collaborate cross-functionally, and deliver documented processes on a 6-month contract.
156k – 208k/yr
Remote5+ YOEData Engineering
Senior Data Engineer
CheckrDenver, CO +1
Senior Data Engineer building and scaling Checkr's centralized People Data platform and large-scale batch/streaming pipelines that power identity and people records for all products. Requires 5+ years experience with Python, PySpark, SQL, Spark, Kafka and AWS data services; leads execution, mentors, and partners with cross-functional teams.
157k – 218k/yr
Hybrid5+ YOEData Engineering
Senior Data Engineer
OtterMountain View, CA
As a Software Engineer, Data Infrastructure, you will design and build resilient and scalable data systems for real-time data movement, processing, and storage. You will drive innovation in data ingestion, transformation, and delivery, enabling actionable insights across the company.
155k – 185k/yr
Hybrid4+ YOEData Engineering
Senior Software Engineer - Distributed Data Systems
DatabricksBellevue, WA
Build distributed data storage and processing systems for big data workloads including Apache Spark, Delta Lake, and performance optimization. Requires 5+ years in Java/Scala/C++, strong algorithms knowledge, and distributed systems experience.
158k – 214k/yr
On-site5+ YOEData Engineering
Senior Backend Engineer, Data Platform
LaunchdarklyAustin, TX +8
Senior Backend Engineer building and operating distributed data infrastructure for streaming, batch processing, analytical stores, and warehouse exports at scale. Requires 6+ years backend experience with data pipelines, distributed systems, and production ownership (on-call).