Senior Data Engineer
Senior Data Engineer building and scaling Checkr's centralized People Data platform and large-scale batch/streaming pipelines that power identity and people records for all products. Requires 5+ years experience with Python, PySpark, SQL, Spark, Kafka and AWS data services; leads execution, mentors, and partners with cross-functional teams.
About the job
What you'll do
- Design, build, and ship new capabilities and data pipelines for the People Data platform, from design through release
- Lead the execution of core services with strong ownership, balancing speed to market with long-term scalability and reliability
- Build and maintain large-scale data processing pipelines (batch and streaming) that serve identity and people records across Checkr's products
- Partner with Product and cross-functional teams to scope appropriately sized initiatives and shape a roadmap that meets business needs quarter over quarter
- Ensure platform availability and data accuracy by participating in on-call rotation, resolving production issues, and driving preventative improvements
- Mentor engineers on the team and contribute to the broader engineering organization through technical reviews, showcases, and proposals
What you bring
- 5+ years of software engineering experience building scalable, performant data platforms or backend services
- Strong proficiency in Python, PySpark, and SQL, with solid Computer Science fundamentals across data structures, algorithms, and relational/NoSQL databases (e.g., MongoDB)
- Experience building large-scale data processing pipelines using ETL/ELT, batch, and stream processing
- Familiarity with big data technologies such as Kafka, Spark, Iceberg, and data lakes, and the AWS stack (EKS, EMR, Glue, Athena, S3)
- Experience with data modeling, domain modeling, and system architecture, with a proven track record of writing clear, tested code
- Knowledge of security best practices and data privacy concerns, and a strong sense of ownership across the full development lifecycle
Nice to have: experience with data processing platforms such as Databricks or Snowflake
Compensation & Benefits
- Base salary range (San Francisco, CA): $185,000–$218,000 USD
- Base salary range (Denver, CO): $157,000–$185,000 USD
- Competitive cash and equity compensation
- 100% medical, dental, and vision coverage
- Up to $25K reimbursement for fertility, adoption, and parental planning services
- Flexible PTO policy
- Monthly wellness stipend
- Learning and development allowance
Skills
Python, Pyspark, SQL, MongoDB, Kafka, Spark, Iceberg, AWS, ETL, ELT, Databricks, Snowflake
Similar jobs
Data Engineering jobs
Vanta
Remote
Senior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.
Gusto
Denver, COThe Senior Data Engineer will build scalable pipelines, ETL workflows, and data products while partnering with analytics, product, and engineering teams. The role requires 8–10+ years of experience, strong SQL and programming skills, cloud data-platform expertise, and a focus on reliability, quality, and automation.
Underdog Fantasy
United States
Build and own the data platform powering regulatory reporting for a federally regulated prediction-markets business. The role combines dbt and SQL engineering, automated validation, root-cause investigations, audit support, and direct collaboration with regulators and compliance.
Granica
Mountain View, CA
Build and optimize foundational lakehouse infrastructure for AI, spanning metadata, transactions, table maintenance, storage layout, and query performance at massive scale. The role requires senior systems engineering experience with modern lakehouse technologies, columnar formats, cloud object storage, and systems-oriented programming languages.
tastytrade
Chicago, IL
Own the performance, availability, backup and recovery, upgrades, and observability of high-throughput PostgreSQL environments across on-premises infrastructure and Amazon RDS. The senior role requires production Patroni failover experience, deep PostgreSQL expertise, Linux fundamentals, software development proficiency, and strong documentation skills.