Senior Backend Engineer, Data Platform
Senior Backend Engineer building and operating distributed data infrastructure for streaming, batch processing, analytical stores, and warehouse exports at scale. Requires 6+ years backend experience with data pipelines, distributed systems, and production ownership (on-call).
About the job
Responsibilities
- Design, build, and operate distributed, data-intensive backend systems that power Data Platform capabilities across Experimentation, Metrics, Release Guardian, Observability, Agent Control, and other product areas.
- Own and improve production data infrastructure, including streaming and batch pipelines, analytical data stores, warehouse export systems, observability, alerting, reliability, and performance.
- Debug and resolve complex production issues across data pipelines, databases, cloud infrastructure, and distributed systems, including participating in the team’s on-call rotation.
- Partner with product managers, frontend engineers, UX designers, and other product engineering teams to deliver reliable customer-facing data capabilities.
- Write and review technical proposals, contribute to architecture decisions, and help the team make thoughtful trade-offs around scalability, reliability, cost, and operability.
- Improve engineering standards, testing practices, deployment safety, observability, tooling, and operational processes for Data Platform systems.
- Write maintainable, well-tested code and actively participate in code reviews, design reviews, and production readiness discussions.
Qualifications
- 6+ years of professional backend software engineering experience, including significant experience with infrastructure, data platform, distributed systems, or data-intensive production systems.
- Experience designing, building, operating, and debugging reliable production systems that move, store, process, or query large volumes of data.
- Hands-on experience with data pipeline, streaming, orchestration, or batch-processing technologies such as Kinesis, Airflow, Spark, Lambda, Flink, Athena, Kafka, or equivalent systems.
- Experience working with analytical, event, warehouse, or operational data stores such as ClickHouse, Postgres, Elasticsearch, Timestream, Glue/Iceberg/S3, Redshift, Databricks, or equivalent systems.
- Strong programming experience in Go, Python, SQL, Scala, or similar backend languages.
- Familiarity with distributed systems and backend engineering fundamentals such as concurrency, data modeling, failure handling, retries, idempotency, partitioning, backpressure, and high-throughput processing.
- Experience with infrastructure-as-code tools such as Terraform or equivalent, and observability tools such as Datadog, New Relic, or equivalent.
- A strong ownership mindset for production systems, including maintainability, testing, operational excellence, code quality, collaboration, and clear technical communication.
Compensation
Target pay ranges based on Geographic Zones* for Level 4:
- Zone 1: San Francisco/Bay Area or NYC Metropolitan Area, Boston, Seattle - $187,000 - $257,000
- Zone 2: Irvine, LA, Monterey, Santa Barbara, Santa Rosa, Austin, Portland, Philadelphia, Chicago - $168,000 - $231,000
- Zone 3: All other US locations - $158,000 - $218,000
*Restricted Stock Units (RSUs), health, vision, and dental insurance, and mental health benefits in addition to salary.
Skills
Go, Python, SQL, Scala, Kinesis, Airflow, Spark, AWS Lambda, Flink, Athena, Kafka, ClickHouse, Postgres, Elasticsearch, Iceberg
Similar jobs
Data Engineering jobsSenior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.
Build and own the data platform powering regulatory reporting for a federally regulated prediction-markets business. The role combines dbt and SQL engineering, automated validation, root-cause investigations, audit support, and direct collaboration with regulators and compliance.
Build and optimize foundational lakehouse infrastructure for AI, spanning metadata, transactions, table maintenance, storage layout, and query performance at massive scale. The role requires senior systems engineering experience with modern lakehouse technologies, columnar formats, cloud object storage, and systems-oriented programming languages.
The Senior Data Engineer will build scalable pipelines, ETL workflows, and data products while partnering with analytics, product, and engineering teams. The role requires 8–10+ years of experience, strong SQL and programming skills, cloud data-platform expertise, and a focus on reliability, quality, and automation.
Own the company’s metric governance program by defining canonical metrics, enforcing them in semantic and catalog systems, improving data quality, and validating AI-agent outputs. Requires 5+ years in analytics or analytics engineering, strong SQL, production semantic-layer ownership, and experience with AI evaluation and data governance.