# Senior Data Engineer, Knowledge & Information

**Company:** [Komodo Health](https://hotfix.jobs/companies/komodo-health)
**Location:** New York, NY, San Francisco, CA, Chicago, IL
**Role:** Data Engineering
**Salary:** $153k – $238k/yr
**Experience:** 5+ years
**Skills:** Python, SQL, Airflow, Spark, AWS, Data Pipelines, Data Quality, Observability, CI/CD, LLMs
**Posted:** 2026-05-22

> Design, build, and operate large-scale data pipelines that power Komodo's Healthcare Map and downstream analytics/AI use cases. Requires strong Python, SQL, Airflow, Spark, and AWS experience building production-grade systems.

## Job Description

## Responsibilities
- Build, operate, and optimize large-scale production data pipelines using Python, SQL, Airflow, cloud infrastructure, and distributed processing frameworks.
- Implement robust data quality checks, validation, lineage, observability, monitoring, and alerting.
- Design and scale agentic data acquisition and extraction systems for complex, unstructured public data sources; develop LLM-powered Human-in-the-Loop (HITL) pipelines for data extraction and curation.
- Transform healthcare claims, EHR, non-claims-based, and reference datasets into trusted, performant Healthcare Map data products.
- Contribute to system design, architecture, code quality, testing, documentation, CI/CD, and rotational production support.
- Debug complex data, system, and performance issues across computationally intensive workflows.
- Partner with Data Product Quality, Product, Platform, and Engineering teams to translate healthcare data needs into scalable technical solutions.

## Requirements
- Strong hands-on experience building, operating, and debugging production-grade data pipelines at scale in AWS.
- Advanced Python and SQL skills.
- Experience with Airflow or similar orchestration tools and Spark or comparable distributed processing frameworks.
- Ability to communicate technical trade-offs clearly and collaborate across engineering, product, and data teams.
- Comfort using AI-assisted engineering tools for productivity, debugging, documentation, and technical exploration.
- Must leverage AI-augmented engineering tools (ChatGPT, Gemini, Claude) to improve productivity and technical decision-making.

## Nice to Haves
- Healthcare data experience.
- Experience optimizing high-scale data architectures for performance, cost, versioning, and large-volume productization.
- Experience applying AI or agentic workflows to engineering, data quality, delivery, or operations.
- Proven success in high-growth or ambiguous environments.

## Benefits
- Comprehensive health, dental, and vision insurance.
- Flexible time off and holidays.
- 401(k) with company match.
- Disability insurance and life insurance.
- Leaves of absence in accordance with applicable state and local laws.

## Similar roles

- [Senior Data Engineer, Data Foundations](https://hotfix.jobs/jobs/2d22e498-0401-4924-bad9-9bc770aabdbe) - Komodo Health - Remote - $153k – $207k/yr
- [Senior Software Engineer - Data Infrastructure](https://hotfix.jobs/jobs/fea33de0-09c5-48fe-96c4-c578b36f3d47) - Applied Intuition - Sunnyvale, CA - $153k – $222k/yr
- [Senior Data Platform Engineer](https://hotfix.jobs/jobs/094eb124-f8e3-4e63-8c17-aa39d45e3245) - 1Password - Remote - $152k – $198k/yr
- [Senior Data Engineer, Reporting & Analytics](https://hotfix.jobs/jobs/eefebb7a-83f3-4126-a221-2b5b3a6275a9) - Drata - San Francisco, CA - $152k – $205k/yr
- [Senior Data Engineer](https://hotfix.jobs/jobs/3e0ab1a5-3042-4b30-9270-c36019d0aaad) - Otter - Mountain View, CA - $155k – $185k/yr

**Apply:** https://hotfix.jobs/jobs/dfdf879e-82ea-412b-86d3-ec5091121e27
**Canonical:** https://hotfix.jobs/jobs/dfdf879e-82ea-412b-86d3-ec5091121e27