Senior Data Engineer
Designs and operates scalable data platforms, pipelines, governance frameworks, and AI/ML data infrastructure using modern cloud and lakehouse technologies. Requires a bachelor’s degree and at least five years of professional data engineering or full-stack experience.
About the job
Responsibilities
- Design, build, and maintain scalable data platforms using AWS, Snowflake, dbt, and Databricks.
- Manage infrastructure as code with Terraform to provide consistent, reproducible environments.
- Develop and maintain CI/CD pipelines for data platform applications using GitHub and GitLab.
- Engineer reliable data pipelines and feature-rich datasets for AI and machine learning systems.
- Implement data governance frameworks covering data lineage, compliance, and quality across analytical platforms.
- Conduct vulnerability scans, apply patches, and maintain data security standards.
- Explore automation tools, including data engineering agents, to streamline routine tasks.
- Collaborate with data engineers, analysts, scientists, product managers, UX designers, and developers to deliver end-to-end solutions.
Requirements
- Bachelor of Science degree in Computer Science, Engineering, or another quantitative field.
- 5+ years of professional experience in data engineering or a full-stack role.
- Expert-level SQL and ETL knowledge, including Airflow and dbt.
- Experience with relational or columnar MPP databases such as Snowflake or Redshift.
- Hands-on AWS experience, including S3, Lambda, EMR, EC2, and EKS.
- Experience with lakehouse architectures, particularly Databricks, and file formats such as Iceberg and Delta.
- Proficiency with Docker and Kubernetes.
- Excellent oral and written communication skills for technical and non-technical audiences.
Nice to Have
- Experience with current AI technologies.
- Experience coaching and developing individuals.
- Familiarity with cloud cost optimization and FinOps.
- Experience in SaaS, security, or identity industries.
Skills
AWS, Snowflake, dbt, Databricks, Terraform, GitHub, GitLab, SQL, Apache Airflow, Redshift, Docker, Kubernetes, Apache Iceberg, Delta Lake, Finops
Similar jobs
Data Engineering jobs
Alpaca
Remote
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
StarTree
India
Build and operate distributed systems powering Apache Pinot’s real-time analytics platform at massive scale. The role requires strong distributed-systems expertise, end-to-end delivery ownership, and a focus on reliability, observability, and performance.
Earnin
Bengaluru, India
Senior data platform engineer who scales infrastructure, automates data delivery, builds AI-enabled analytical tools, and leads cross-functional engineering initiatives. Requires 4+ years of data infrastructure experience, strong Kafka and distributed-systems expertise, and proficiency in Python, Scala, cloud platforms, and Terraform.
Fivetran
Bengaluru, India
Senior Software Engineer building reliable connectors and high-volume data pipelines that move customer data into warehouses. The role requires strong Java, cloud, database, distributed-systems, and technical leadership experience.
Snowflake
Pune, India
Build and operate scalable enterprise data pipelines, models, and platform infrastructure across the full data lifecycle. The role requires 5+ years of experience, strong SQL and Python, and deep expertise in Snowflake, dbt, and Airflow.