Senior Platform Engineer, Data
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
About the job
Responsibilities
- Lead the team’s orchestration consolidation to Dagster end-to-end, from technical design through implementation and rollout.
- Contribute to custom dbt-core infrastructure supporting more than 50 dbt projects and 15,000 models.
- Design and implement Python abstractions for data tooling, providing consistent structure and conventions for new projects and pipelines.
- Develop proactive monitoring and alerting for tooling and data pipelines.
- Own technical solutions while mentoring junior engineers and fostering learning, collaboration, and technical excellence.
- Improve Databricks developer experience by developing tooling, defaults, and guardrails for team-managed workloads.
Requirements
- 5+ years of experience building, shipping, and supporting software in production.
- Experienced Python engineer who has built and operated systems on AWS, including internal tools and complex job orchestration with Dagster or Airflow.
- Experience owning features from idea through production, including design, implementation, testing, and ongoing improvements.
- Experience deploying and operating cloud infrastructure with infrastructure as code, such as Terraform.
- Experience building or contributing to CI processes.
- Experience using and contributing to AI tooling that supports developer productivity, code quality, and engineering best practices.
- Experience as a data or platform engineer in a modern data stack environment, ideally at a fast-moving, early-stage, or growth-stage company.
- Familiarity with software engineering practices including unit tests, code reviews, and design documentation.
- Experience building internal tools and systems.
- Comfort with ambiguity, ownership, collaboration, and continuous learning.
Nice to have
- Hands-on experience with Databricks or Snowflake.
- Experience building, deploying, and maintaining dbt at scale.
- Prior healthcare or health technology experience.
Compensation and benefits
- Base salary: $175,500–$195,000.
- Total compensation also includes equity, benefits, and other opportunities.
- Individual pay decisions consider qualifications, experience, skill set, and internal equity.
Skills
Python, AWS, Dagster, Airflow, Terraform, dbt, Databricks, Snowflake, CI/CD, Data Pipelines, Monitoring, Alerting, Infrastructure As Code, Unit Testing, Code Reviews
Similar jobs
Data Engineering jobs
Fetch
United States
Senior software engineer building and evolving Fetch’s data platform, including pipelines, governed data access, delivery infrastructure, and partner integrations. The role requires 8+ years of experience, strong platform or backend expertise, ownership of complex cross-team initiatives, and excellent technical judgment.
Runpod
San Francisco, CA
The Senior Data Engineer will design scalable data pipelines and warehousing systems supporting analytics, business metrics, and machine-learning initiatives. The role requires 4+ years of enterprise data experience, expertise with modern data platforms and ETL, and the ability to mentor engineers and collaborate across functions.
Atticus
Los Angeles, CA
Lead the development and maintenance of scalable data pipelines, warehouse, and transformation layer using modern data stack. Collaborate with data scientists and analysts to ensure clean, reliable data for insights in a high-growth startup.
Creditgenie
Plymouth Meeting, PASenior Data Engineer responsible for designing and operating scalable data pipelines and platform capabilities across Snowflake and AWS. The role requires 5+ years of production data engineering experience, strong SQL and Python skills, and expertise in ETL/ELT, orchestration, quality, and observability.
Machinify
United States
Build and scale production data pipelines that transform raw healthcare and customer data into trusted canonical datasets powering ML models, dashboards, and product decisions. The role requires 6+ years of data engineering experience and strong Python, Spark SQL, and Airflow expertise.