Senior Data Engineer
Senior data engineer who will set architecture standards, lead large-scale pipeline initiatives, and build reliable cloud-native data platforms on AWS. The role requires expertise in orchestration, batch and streaming systems, infrastructure as code, and modern data architectures.
About the job
Responsibilities
- Serve as a senior technical reference for data engineering, establishing data modeling and data pipeline architecture standards and best practices.
- Lead high-impact data engineering initiatives across multiple domains.
- Partner with Product, Finance, Engineering, and business teams to translate strategic needs into reliable, scalable data solutions.
- Evaluate build-versus-buy decisions for product analytics and data infrastructure.
- Manage technical debt while maintaining scalability, reliability, and maintainability.
Requirements
- Proven experience as a senior data engineer owning large-scale data pipelines and complex data architectures.
- Strong technical judgment, problem-solving skills, attention to detail, and process-improvement mindset.
- Understanding of modern data engineering practices, including data lakes, lakehouse architectures, and ETL/ELT.
- Experience designing and operating cloud-native data platforms on AWS, including orchestration, storage, compute, and IAM.
- Strong experience with orchestration and workflow tools such as Airflow.
- Working knowledge of infrastructure-as-code principles and tools such as Terraform.
- Experience building and operating batch and streaming data systems, including trade-offs between them.
- Strong communication and collaboration skills in a distributed, international environment.
Nice to Have
- DBT and metadata/catalog tools.
- DMS, AppFlow, SQS, and SNS.
- Data Mesh and domain-driven data architecture patterns.
- Experience delivering production-grade software systems.
- Kafka, Kinesis, and Spark Streaming.
Compensation and Benefits
- Compensation is paid in BRL under a CLT employment arrangement.
- Remote-first culture with in-person team events throughout the year.
Skills
AWS, Data Lakes, Lakehouse, ETL, ELT, Apache Airflow, Terraform, Kafka, Amazon Kinesis, Spark, dbt, Aws Iam, Amazon Sqs, Amazon Sns, Aws Dms
Similar jobs
Data Engineering jobsBuild and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.
Senior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.
Leads the re-platforming of Vanta’s compliance data layer from MongoDB to schema-aware PostgreSQL across high-throughput Kafka and S3 pipelines. The role requires staff-level distributed systems expertise, migration leadership, and strong experience with relational and document data modeling.