Senior Software Engineer, Data Platform
Build and operate trusted, scalable data-platform capabilities spanning warehousing, orchestration, governance, BI, and developer tooling. The role requires senior software engineering experience, strong Python skills, modern data-platform expertise, and Terraform proficiency.
About the job
Responsibilities
- Design, build, and operate data-platform capabilities for warehousing, orchestration, business intelligence, and data governance.
- Build reliable Python services and developer-facing tools for creating and operating data products.
- Develop scalable infrastructure as code with Terraform.
- Establish patterns for managing petabyte-scale data with strong governance, security, reliability, and usability.
- Partner with data engineers, analysts, scientists, and product teams to develop durable platform capabilities.
- Evaluate and build agentic workflows with appropriate controls and observability.
- Set technical direction, improve engineering standards, and mentor engineers.
Requirements
- Senior-level software engineering experience with strong Python skills and experience designing, shipping, and operating production systems.
- Experience building or operating data platforms, data products, or large-scale data infrastructure.
- Experience with Snowflake, Databricks, or comparable modern data platforms.
- Experience with Terraform and infrastructure-as-code practices.
- Understanding of the performance, cost, reliability, access control, lineage, quality, and governance tradeoffs of petabyte-scale data.
- Experience collaborating directly with data practitioners.
- Strong technical judgment, communication, and cross-team leadership.
Technologies
- Python
- Kotlin
- Snowflake
- Databricks
- Apache Iceberg
- Apache Airflow
- dbt
- Prefect
- Terraform
- Buildkite
- GitOps
- DataHub
- Anomalo
- Looker
- Omni
- AWS
Compensation and Benefits
- U.S. starting pay ranges from $185,200 to $326,800 USD depending on zone, location, skills, experience, qualifications, and market conditions.
- Benefits include remote work, medical insurance, flexible time off, retirement savings plans, and modern family planning.
Skills
Python, Kotlin, Snowflake, Databricks, Apache Iceberg, Apache Airflow, dbt, Terraform, GitOps, Datahub, Looker, AWS
Similar jobs
Data Engineering jobs
Otter
Mountain View, CA
Build and own foundational data models, reliable pipelines, and data platforms that support analytics and business decision-making. The role requires 5+ years of data engineering experience, strong Python and SQL skills, cloud data warehouse expertise, and a bachelor's degree or equivalent experience.
Instacart
United StatesOwn financial data integration pipelines and scalable data models supporting accounting, billing, revenue, and financial reporting. The role requires 8+ years of data or software engineering experience, strong cloud warehouse and data infrastructure expertise, and the ability to lead cross-functional initiatives.
Jump
United States
Build and operate Jump’s Snowflake and dbt data platform, including ELT pipelines, governance, testing, monitoring, and analytics models. The role requires 6+ years of data engineering experience, production-grade SQL and Snowflake expertise, deep dbt knowledge, and strong Python and software engineering practices.
Vanta
Remote
Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.
Creditgenie
Plymouth Meeting, PASenior Data Engineer responsible for designing and operating scalable data pipelines and platform capabilities across Snowflake and AWS. The role requires 5+ years of production data engineering experience, strong SQL and Python skills, and expertise in ETL/ELT, orchestration, quality, and observability.