Senior Data Engineer
Builds and maintains scalable data platforms and pipelines that support analytics and AI/ML systems. The role requires 5+ years of data engineering or full-stack experience, strong SQL and ETL expertise, cloud infrastructure experience, and a bachelor's degree.
About the job
Responsibilities
- Design and develop scalable data platforms using AWS, Snowflake, dbt, and Databricks.
- Use Terraform for infrastructure as code and reproducible environments.
- Develop and maintain CI/CD pipelines for data platform applications using GitHub and GitLab.
- Engineer reliable data pipelines and feature-rich datasets for AI and machine learning systems.
- Implement data governance frameworks covering data lineage, compliance, and quality.
- Conduct vulnerability scans, apply patches, and maintain data security standards.
- Explore automation tools such as data engineering agents.
- Collaborate with product managers, UX designers, data engineers, analysts, scientists, and developers to deliver end-to-end solutions.
Requirements
- Bachelor's degree in Computer Science, Engineering, or another quantitative field.
- 5+ years of professional experience in data engineering or a full-stack role.
- Expert knowledge of SQL and ETL tools such as Airflow and dbt.
- Experience with relational or columnar MPP databases such as Snowflake or Redshift.
- Hands-on experience with AWS, including S3, Lambda, EMR, EC2, and EKS.
- Experience with lakehouse architectures such as Databricks and file formats including Iceberg and Delta.
- Proficiency with Docker and Kubernetes.
- Excellent oral and written communication skills for technical and non-technical audiences.
Nice-to-Haves
- Experience with current AI technologies.
- Experience coaching and developing individuals.
- Familiarity with cloud cost optimization and FinOps.
- Background in SaaS, security, or identity industries.
Benefits
- In-person onboarding experience.
- Well-being support.
- Social impact initiatives.
- Talent development and community-building programs.
Skills
AWS, Snowflake, dbt, Databricks, Terraform, GitHub, GitLab, SQL, Airflow, Redshift, Docker, Kubernetes, Apache Iceberg, Delta Lake, Aws S3
Similar jobs
Data Engineering jobs
Alpaca
Remote
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
StarTree
India
Build and operate distributed systems powering Apache Pinot’s real-time analytics platform at massive scale. The role requires strong distributed-systems expertise, end-to-end delivery ownership, and a focus on reliability, observability, and performance.
Earnin
Bengaluru, India
Senior data platform engineer who scales infrastructure, automates data delivery, builds AI-enabled analytical tools, and leads cross-functional engineering initiatives. Requires 4+ years of data infrastructure experience, strong Kafka and distributed-systems expertise, and proficiency in Python, Scala, cloud platforms, and Terraform.
Fivetran
Bengaluru, India
Senior Software Engineer building reliable connectors and high-volume data pipelines that move customer data into warehouses. The role requires strong Java, cloud, database, distributed-systems, and technical leadership experience.
Snowflake
Pune, India
Build and operate scalable enterprise data pipelines, models, and platform infrastructure across the full data lifecycle. The role requires 5+ years of experience, strong SQL and Python, and deep expertise in Snowflake, dbt, and Airflow.