Skip to content
ClickhouseClickhouseUnited States

Senior Data Engineer - Python, CI/CD

Builds and optimizes large-scale data pipelines using Airflow, dbt, and Python on a ClickHouse-powered data warehouse. Designs reusable components, data models, and DataOps tooling while mentoring the team and ensuring platform reliability.

84k – 170k/yr
RemoteData Engineering

About the role

Key Responsibilities

DWH Platform Development

  • Design and develop reusable Airflow components - operators, connectors, and hooks - along with custom integrations tailored to our data architecture.
  • Build reusable dbt macros and abstractions: incremental strategies, ETL building blocks, and generic data quality tests, all optimized for ClickHouse-specific behavior and our data patterns.
  • Develop DataOps tooling - CI pipelines, data migration frameworks, and security controls - with a strong focus on reliability, self-service usability, and scale.

Team contributions

  • Conduct thorough code reviews for team members and other team contributors.
  • Actively participate in technical and architectural design discussions.
  • Drive technical leadership in specific areas of our stack.
  • Continuously improve the team's development environment, with a focus on automation - including AI-assisted workflows.
  • Contribute to platform stability through proactive troubleshooting and timely incident resolution.

Data modeling

  • Develop, refactor, and optimize business data models in line with our modeling standards and ClickHouse best practices.
  • Mentor and support contributors through code reviews and technical guidance.
  • Lead the design and implementation of the most technically demanding data marts - particularly those involving high data velocity, large volumes, or complex business logic.

Qualifications

Required:

  • Exceptional SQL skills - this is non-negotiable.
  • Strong hands-on experience with Airflow, dbt, and Python.
  • Proven track record building and optimizing large-scale, high-throughput data pipelines.
  • Solid understanding of data warehousing fundamentals: ETL/ELT, dimensional modeling, and data quality.
  • Bachelor's degree in Computer Science or a related field.
  • Comfortable thriving in a fast-paced startup environment — exciting and dynamic, but sometimes wonderfully chaotic.

Preferred:

  • Hands-on experience with ClickHouse - a significant advantage.
  • Familiarity with AWS or other cloud platforms.
  • Experience with CI/CD development, especially using GitHub Actions.

Skills

SQLPythonAirflowdbtClickHouseAWSGitHub ActionsETLELTCI/CD

Similar roles

Data Engineering jobs
Imagen Technologies

Sr. Healthcare Integrations Engineer

Imagen TechnologiesUnited States

As a Senior Healthcare Integrations Engineer, you will lead and implement integrations between client EMR systems and Imagen's cloud-based systems. This hands-on technical role involves partnering with internal and external stakeholders to deliver high-quality data exchange solutions and providing ongoing support.

80k – 195k/yr
Remote5+ YOEData Engineering
NinjaTrader

Sr. Data Engineer

NinjaTraderChicago, IL +23

Design and maintain scalable data pipelines and lake architecture on GCP/AWS to power analytics, trading tools, and ML initiatives. Requires 5+ years experience, strong SQL/Python, dbt, orchestration tools, and cloud infrastructure experience.

100k – 150k/yr
Hybrid5+ YOEData Engineering
Mozilla

Senior Data Engineer

MozillaUnited States

Senior Data Engineer builds and manages data pipelines, transforms telemetry into reliable datasets, ensures data quality and governance on GCP. Requires 4+ years experience, SQL/Python proficiency, strong modeling skills.

104k – 164k/yr
Remote4+ YOEData Engineering
15Five

Senior Software Engineer

15FiveUnited States

Build and evolve the Data Intelligence Platform powering AI and agentic features. Partner with Data Science and Product teams on pipelines, autonomous agents, and scalable data infrastructure. Requires 5+ years experience in data/AI engineering.

121k – 160k/yr
Remote5+ YOEData Engineering
Pinterest

Sr. Data Engineer, tvScientific

PinterestSan Francisco, CA

Senior Data Engineer builds scalable data infrastructure using Spark, Scala, and AWS. Evolves pipelines for growth, collaborates cross-functionally, and optimizes data storage. Requires production experience, proficiency in key tools, and bachelor's degree.

124k – 255k/yr
RemoteData Engineering