Design, build, and operate large-scale data pipelines that power Komodo's Healthcare Map and downstream analytics/AI use cases. Requires strong Python, SQL, Airflow, Spark, and AWS experience building production-grade systems.
153k – 238k/yr
Hybrid5+ YOEData Engineering
About the role
Responsibilities
Build, operate, and optimize large-scale production data pipelines using Python, SQL, Airflow, cloud infrastructure, and distributed processing frameworks.
Implement robust data quality checks, validation, lineage, observability, monitoring, and alerting.
Design and scale agentic data acquisition and extraction systems for complex, unstructured public data sources; develop LLM-powered Human-in-the-Loop (HITL) pipelines for data extraction and curation.
Transform healthcare claims, EHR, non-claims-based, and reference datasets into trusted, performant Healthcare Map data products.
Contribute to system design, architecture, code quality, testing, documentation, CI/CD, and rotational production support.
Debug complex data, system, and performance issues across computationally intensive workflows.
Partner with Data Product Quality, Product, Platform, and Engineering teams to translate healthcare data needs into scalable technical solutions.
Requirements
Strong hands-on experience building, operating, and debugging production-grade data pipelines at scale in AWS.
Advanced Python and SQL skills.
Experience with Airflow or similar orchestration tools and Spark or comparable distributed processing frameworks.
Ability to communicate technical trade-offs clearly and collaborate across engineering, product, and data teams.
Comfort using AI-assisted engineering tools for productivity, debugging, documentation, and technical exploration.
Must leverage AI-augmented engineering tools (ChatGPT, Gemini, Claude) to improve productivity and technical decision-making.
Nice to Haves
Healthcare data experience.
Experience optimizing high-scale data architectures for performance, cost, versioning, and large-volume productization.
Experience applying AI or agentic workflows to engineering, data quality, delivery, or operations.
Proven success in high-growth or ambiguous environments.
Benefits
Comprehensive health, dental, and vision insurance.
Flexible time off and holidays.
401(k) with company match.
Disability insurance and life insurance.
Leaves of absence in accordance with applicable state and local laws.
Designs, implements, and scales foundational data pipelines processing massive healthcare datasets using Spark, Python, Rust, and SQL. Leads cross-functional initiatives, ensures data quality, and enables AI/ML workflows for production-grade data products.
153k – 207k/yr
RemoteData Engineering
Senior Software Engineer - Data Infrastructure
Applied IntuitionSunnyvale, CA
Builds and scales data infrastructure across the full lifecycle (collection, ingestion, storage, querying) using open-source technologies like Spark and Kafka. Supports cloud, hybrid, and on-prem deployments while collaborating across business units. Requires 3+ years experience and Bachelor's degree.
153k – 222k/yr
On-site3+ YOEData Engineering
Senior Data Platform Engineer
1PasswordUnited States
Senior Data Platform Engineer building a streaming-first, domain-oriented data platform on Kafka, Iceberg, Databricks, and Snowflake to enable near real-time governed data access.
152k – 198k/yr
Remote7+ YOEData Engineering
Senior Data Engineer, Reporting & Analytics
DrataSan Francisco, CA
Senior data engineer building scalable data products, models, and governance processes. Focus on automation, performance optimization, and enabling self-serve analytics for a fast-growing SaaS company.
152k – 205k/yr
Hybrid5+ YOEData Engineering
Senior Data Engineer
OtterMountain View, CA
As a Software Engineer, Data Infrastructure, you will design and build resilient and scalable data systems for real-time data movement, processing, and storage. You will drive innovation in data ingestion, transformation, and delivery, enabling actionable insights across the company.