Skip to content
Komodo HealthKomodo HealthNew York, NY

Senior Data Engineer, Knowledge & Information

Design, build, and operate large-scale data pipelines that power Komodo's Healthcare Map and downstream analytics/AI use cases. Requires strong Python, SQL, Airflow, Spark, and AWS experience building production-grade systems.

153k – 238k/yr
Hybrid5+ YOEData Engineering

About the role

Responsibilities

  • Build, operate, and optimize large-scale production data pipelines using Python, SQL, Airflow, cloud infrastructure, and distributed processing frameworks.
  • Implement robust data quality checks, validation, lineage, observability, monitoring, and alerting.
  • Design and scale agentic data acquisition and extraction systems for complex, unstructured public data sources; develop LLM-powered Human-in-the-Loop (HITL) pipelines for data extraction and curation.
  • Transform healthcare claims, EHR, non-claims-based, and reference datasets into trusted, performant Healthcare Map data products.
  • Contribute to system design, architecture, code quality, testing, documentation, CI/CD, and rotational production support.
  • Debug complex data, system, and performance issues across computationally intensive workflows.
  • Partner with Data Product Quality, Product, Platform, and Engineering teams to translate healthcare data needs into scalable technical solutions.

Requirements

  • Strong hands-on experience building, operating, and debugging production-grade data pipelines at scale in AWS.
  • Advanced Python and SQL skills.
  • Experience with Airflow or similar orchestration tools and Spark or comparable distributed processing frameworks.
  • Ability to communicate technical trade-offs clearly and collaborate across engineering, product, and data teams.
  • Comfort using AI-assisted engineering tools for productivity, debugging, documentation, and technical exploration.
  • Must leverage AI-augmented engineering tools (ChatGPT, Gemini, Claude) to improve productivity and technical decision-making.

Nice to Haves

  • Healthcare data experience.
  • Experience optimizing high-scale data architectures for performance, cost, versioning, and large-volume productization.
  • Experience applying AI or agentic workflows to engineering, data quality, delivery, or operations.
  • Proven success in high-growth or ambiguous environments.

Benefits

  • Comprehensive health, dental, and vision insurance.
  • Flexible time off and holidays.
  • 401(k) with company match.
  • Disability insurance and life insurance.
  • Leaves of absence in accordance with applicable state and local laws.

Skills

PythonSQLAirflowSparkAWSData PipelinesData QualityObservabilityCI/CDLLMs
Komodo Health

Senior Data Engineer, Data Foundations

Komodo HealthSan Francisco, CA +1

Designs, implements, and scales foundational data pipelines processing massive healthcare datasets using Spark, Python, Rust, and SQL. Leads cross-functional initiatives, ensures data quality, and enables AI/ML workflows for production-grade data products.

153k – 207k/yr
RemoteData Engineering
Applied Intuition

Senior Software Engineer - Data Infrastructure

Applied IntuitionSunnyvale, CA

Builds and scales data infrastructure across the full lifecycle (collection, ingestion, storage, querying) using open-source technologies like Spark and Kafka. Supports cloud, hybrid, and on-prem deployments while collaborating across business units. Requires 3+ years experience and Bachelor's degree.

153k – 222k/yr
On-site3+ YOEData Engineering
1Password

Senior Data Platform Engineer

1PasswordUnited States

Senior Data Platform Engineer building a streaming-first, domain-oriented data platform on Kafka, Iceberg, Databricks, and Snowflake to enable near real-time governed data access.

152k – 198k/yr
Remote7+ YOEData Engineering
Drata

Senior Data Engineer, Reporting & Analytics

DrataSan Francisco, CA

Senior data engineer building scalable data products, models, and governance processes. Focus on automation, performance optimization, and enabling self-serve analytics for a fast-growing SaaS company.

152k – 205k/yr
Hybrid5+ YOEData Engineering
Otter

Senior Data Engineer

OtterMountain View, CA

As a Software Engineer, Data Infrastructure, you will design and build resilient and scalable data systems for real-time data movement, processing, and storage. You will drive innovation in data ingestion, transformation, and delivery, enabling actionable insights across the company.

155k – 185k/yr
Hybrid4+ YOEData Engineering