Skip to content
Komodo HealthKomodo HealthSan Francisco, CA

Senior Data Engineer, Data Foundations

Designs, implements, and scales foundational data pipelines processing massive healthcare datasets using Spark, Python, Rust, and SQL. Leads cross-functional initiatives, ensures data quality, and enables AI/ML workflows for production-grade data products.

153k – 207k/yr
RemoteData Engineering

About the role

Key Responsibilities

  • Design and implement high-performance data processing and serving patterns across large-scale healthcare datasets using Spark, Python, Rust, and SQL.
  • Lead complex cross-functional initiatives, balancing trade-offs across scalability, reliability, performance, cost, and delivery speed.
  • Build and maintain robust data quality, validation, observability, lineage, monitoring, and alerting frameworks.
  • Architect scalable Healthcare Map data products that power APIs, analytics, internal tooling, and customer-facing applications.
  • Partner with Product, Data Science, and Platform teams to translate healthcare use cases into scalable technical solutions.
  • Drive engineering excellence across system design, code quality, testing, documentation, and CI/CD practices.
  • Mentor engineers through design reviews, technical coaching, and architectural guidance.

What you bring

  • AI & ML Enablement: Experience designing data workflows, feature pipelines, or infrastructure that specifically supports AI/ML training, inference, experimentation, and monitoring.
  • Data Product Engineering: Proven experience building large-scale, production-grade data products and analytical systems.
  • Modern Data Systems: Strong expertise in SQL, distributed processing frameworks (e.g. Spark), cloud data platforms, and high-scale compute systems using Python and/or Rust.
  • Architecture & Systems Design: Demonstrated ability to design scalable data models, platform components, and distributed system architectures.
  • Analytical Rigor: Strong statistical and analytical skills; able to validate data quality and product outcomes through rigorous analysis.
  • Technical Communication: Clear communicator who can explain technical decisions, trade-offs, and risks to engineers, product partners, and leadership.

Nice to have

  • Healthcare Data Experience: Direct experience with claims, clinical, RWE, provider, patient, or life sciences data, including familiarity with coding systems (ICD-10, CPT, NDC, NPI).
  • Data Product Delivery: Experience building and operating data products specifically designed for external consumption via customers, APIs, or serving layers.
  • High-Scale Data Architecture: Proven experience in optimizing systems for performance, cost efficiency, versioning, and large-volume data productization.
  • Applied AI / Agentic Workflows: Experience applying AI/agentic workflows to engineering, data quality, or delivery processes.
  • Fast-Growth Execution: Experience successfully operating in high-growth or ambiguous environments where leaders must adeptly balance architecture, delivery speed, and quality.

Compensation

  • San Francisco Bay Area and New York City: $176,000—$207,000 USD
  • All Other US Locations: $153,000—$180,000 USD
  • Eligible for performance-based bonuses, equity awards, comprehensive health/dental/vision insurance, flexible time off, 401(k) with company match, disability/life insurance.

Skills

SparkPythonRustSQLKubernetesAirflowAWSGCPSnowflakedbtApache KafkaData PipelinesETLData ModelingData Quality Frameworks
Komodo Health

Senior Data Engineer, Knowledge & Information

Komodo HealthNew York, NY +2

Design, build, and operate large-scale data pipelines that power Komodo's Healthcare Map and downstream analytics/AI use cases. Requires strong Python, SQL, Airflow, Spark, and AWS experience building production-grade systems.

153k – 238k/yr
Hybrid5+ YOEData Engineering
Applied Intuition

Senior Software Engineer - Data Infrastructure

Applied IntuitionSunnyvale, CA

Builds and scales data infrastructure across the full lifecycle (collection, ingestion, storage, querying) using open-source technologies like Spark and Kafka. Supports cloud, hybrid, and on-prem deployments while collaborating across business units. Requires 3+ years experience and Bachelor's degree.

153k – 222k/yr
On-site3+ YOEData Engineering
1Password

Senior Data Platform Engineer

1PasswordUnited States

Senior Data Platform Engineer building a streaming-first, domain-oriented data platform on Kafka, Iceberg, Databricks, and Snowflake to enable near real-time governed data access.

152k – 198k/yr
Remote7+ YOEData Engineering
Drata

Senior Data Engineer, Reporting & Analytics

DrataSan Francisco, CA

Senior data engineer building scalable data products, models, and governance processes. Focus on automation, performance optimization, and enabling self-serve analytics for a fast-growing SaaS company.

152k – 205k/yr
Hybrid5+ YOEData Engineering
Otter

Senior Data Engineer

OtterMountain View, CA

As a Software Engineer, Data Infrastructure, you will design and build resilient and scalable data systems for real-time data movement, processing, and storage. You will drive innovation in data ingestion, transformation, and delivery, enabling actionable insights across the company.

155k – 185k/yr
Hybrid4+ YOEData Engineering