Senior Software Engineer, Data
Builds and operates reliable, scalable data pipelines and infrastructure for Auth0’s data platform. The role requires 5+ years of software development experience, strong SQL and Python skills, and hands-on experience with cloud data systems and modern data-stack tools.
About the job
Responsibilities
- Own and operate critical data pipelines and infrastructure, participating in the team's support rotation to ensure high availability and business continuity.
- Lead troubleshooting efforts to resolve complex pipeline or infrastructure issues.
- Manage the data onboarding lifecycle, integrating new internal and external data sources into the platform.
- Develop and deploy robust, scalable data solutions using modern tools and technologies.
- Continuously learn and advocate for modern technologies and best practices to improve data delivery and engineering efficiency.
Requirements
- 5+ years of software development experience, including at least 3+ years working on large-scale data systems.
- Strong proficiency in SQL for data manipulation and Python for data pipeline development.
- Hands-on experience building and operating data pipelines in a cloud environment; AWS preferred.
- Experience with the modern data stack:
- Data warehousing: Snowflake
- Data transformation: dbt
- Infrastructure as code: Terraform
- Experience with data ingestion, streaming, and event-driven architecture, such as Kafka, CDC, and Snowpipe.
- Knowledge of data security and data privacy best practices.
- Strong understanding of data modeling principles.
- Autonomous and proactive approach, with the ability to learn quickly, prioritize needs, and deliver results in a dynamic environment.
Nice to Have
- Experience with Snowpark.
- Experience with containerization and orchestration; Kubernetes is a plus.
- Familiarity with the identity and access management domain.
- Experience building developer-friendly, API-driven applications using REST and/or gRPC.
Skills
SQL, Python, AWS, Snowflake, dbt, Terraform, Kafka, Snowpipe, Snowpark, Kubernetes, Rest, gRPC, Data Modeling, Data Privacy, Data Security
Similar jobs
Data Engineering jobs
Alpaca
Remote
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
StarTree
India
Build and operate distributed systems powering Apache Pinot’s real-time analytics platform at massive scale. The role requires strong distributed-systems expertise, end-to-end delivery ownership, and a focus on reliability, observability, and performance.
Earnin
Bengaluru, India
Senior data platform engineer who scales infrastructure, automates data delivery, builds AI-enabled analytical tools, and leads cross-functional engineering initiatives. Requires 4+ years of data infrastructure experience, strong Kafka and distributed-systems expertise, and proficiency in Python, Scala, cloud platforms, and Terraform.
Fivetran
Bengaluru, India
Senior Software Engineer building reliable connectors and high-volume data pipelines that move customer data into warehouses. The role requires strong Java, cloud, database, distributed-systems, and technical leadership experience.
Snowflake
Pune, India
Build and operate scalable enterprise data pipelines, models, and platform infrastructure across the full data lifecycle. The role requires 5+ years of experience, strong SQL and Python, and deep expertise in Snowflake, dbt, and Airflow.