Senior Data Engineer - Data Platform
Build and evolve large-scale data collection infrastructure and architectures supporting user behavior data, personalization, and recommendation systems. The role requires strong Java and SQL experience, JVM-based data processing expertise, and familiarity with cloud, Kubernetes, and modern engineering practices.
About the job
Responsibilities
- Collaborate with product and engineering teams to build and support critical data infrastructure and datasets.
- Build systems that collect and process user behavior data at scale.
- Support personalization and recommendation systems and tools for building and testing new features.
- Design and evolve data architectures for high data volumes and diverse internal users.
- Improve the reliability, scalability, and usability of data infrastructure.
- Work across disciplines to solve complex data challenges.
Requirements
- Experience as a Data Engineer.
- Proficiency in backend development using Java.
- Experience working with large-scale datasets using SQL and BigQuery.
- Experience with JVM-based data processing frameworks such as Flink, Beam, Dataflow, or Spark.
- Familiarity with DevOps practices, cloud infrastructure, containerized applications, and Kubernetes fundamentals.
- Experience with data modeling and schema design.
- Commitment to high-quality code, continuous delivery, and automated testing.
- Comfort with experimentation, iterative development, collaborative software development, ambiguity, and open-ended problems.
Skills
Java, SQL, BigQuery, Apache Flink, Apache Beam, Google Cloud Dataflow, Spark, DevOps, Cloud Infrastructure, Kubernetes, Data Modeling, Schema Design, Continuous Delivery, Automated Testing
Similar jobs
Data Engineering jobsBuild and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
Designs and builds scalable distributed data systems and pipelines powering blockchain analytics products. The role is hands-on, requiring production experience with Scala, Java, or Python, big-data technologies, cloud infrastructure, and data orchestration, plus technical leadership and mentoring.
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.
Senior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.