Senior Data Engineer
Build and operate the data platform and pipelines that support billing, financial reporting, product analytics, and operational decisions. The role requires strong Python, SQL, data modeling, cloud data platform, orchestration, and infrastructure-as-code experience.
About the job
Responsibilities
- Build systems that turn complex usage and operational data into trustworthy datasets for billing, financial reporting, and product decisions.
- Build and operate the data platform and pipelines that power these use cases.
- Integrate data from internal systems, third-party tools, and external partners into one consistent platform.
- Own data modeling across the warehouse and set standards for data structure as the company scales.
- Work primarily in Python and SQL, using Dagster as the orchestrator.
- Build and maintain cloud infrastructure managed with Terraform.
- Work directly with stakeholders to understand their problems and deliver trusted data.
- Design for correctness and observability through testing, monitoring, and data quality checks.
- Take problems from scoping through production and operate what you build.
Requirements
- Experience designing and operating production data platforms, including ingestion, storage, modeling, orchestration, and reliability.
- Strong data modeling fundamentals and the ability to explain architectural trade-offs.
- Pragmatic, business-focused approach to balancing speed, quality, and long-term maintainability.
- Ability to work through ambiguity and drive underspecified problems to production solutions.
- Effective use and critical review of AI tools in engineering workflows.
- Strong Python and SQL skills.
- Experience with modern cloud data platforms such as BigQuery, Snowflake, or Databricks.
- Experience with data orchestration tools such as Dagster, Airflow, or Prefect.
- Ability to own cloud infrastructure and use infrastructure-as-code tools such as Terraform.
- Clear communication with technical and non-technical stakeholders.
Nice to Have
- Experience with GCP data services such as BigQuery, Pub/Sub, or Dataflow.
- Stream-processing experience.
- Experience with dbt or similar transformation and modeling frameworks.
- Ability to read or contribute to Go or Ruby application code for integrations.
- Experience with financial, billing, metering, or usage data.
Compensation and Benefits
- EU salary range: €90,000–125,000.
- UK salary range: £90,000–125,000.
- Competitive compensation and stock options.
- Home-office or work-setup stipend.
- Learning and development budget.
- Free phone and international data plan.
- Regular collaboration in one of the company hubs, with some remote flexibility and occasional travel.
Skills
Python, SQL, Dagster, Terraform, BigQuery, Snowflake, Databricks, Airflow, Prefect, GCP, Pub/Sub, Dataflow, dbt, Go, Ruby
Similar jobs
Data Engineering jobsSenior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
Own and evolve Stream’s revenue operations data platform, including ingestion, transformation, modeling, reliability, and GCP infrastructure. The role requires 6+ years of production data-platform experience, expert SQL, strong Python, modern ELT, Terraform, and technical leadership.