Senior Data Platform Engineer
Senior data platform engineer who scales infrastructure, automates data delivery, builds AI-enabled analytical tools, and leads cross-functional engineering initiatives. Requires 4+ years of data infrastructure experience, strong Kafka and distributed-systems expertise, and proficiency in Python, Scala, cloud platforms, and Terraform.
About the job
Responsibilities
- Scale data infrastructure, streamline data delivery, and design AI automation to replace manual operations.
- Partner with executive, product, data, and design stakeholders to address data infrastructure challenges, advise on technical data issues, and implement self-service solutions.
- Develop AI-based analytical tools integrated with data pipelines to provide insights into business metrics.
- Architect and manage sophisticated datasets for complex business requirements.
- Mentor engineers through code, design, and architecture reviews.
- Help define technical direction, plan roadmaps, manage risks and timelines, escalate issues, and synthesize feedback.
- Participate in hiring and onboarding.
- Lead cross-team engineering initiatives.
Requirements
- 4+ years of experience designing, building, and maintaining data infrastructure, with experience leading complex projects.
- Bachelor's, master's, or PhD in computer science, computer engineering, or a related technical discipline, or equivalent industry experience.
- Deep knowledge of Kafka and proficiency in Python and Scala.
- Understanding of ML engineering.
- Strong knowledge of distributed computing frameworks such as Apache Spark and cloud platforms such as AWS, Azure, or Google Cloud.
- Experience with database design, SQL, NoSQL databases, large datasets, and database performance optimization.
- Proficiency in Git and Terraform, including continuous integration and continuous deployment practices.
- Experience managing event-driven systems, particularly Kafka in cloud environments.
- Expertise in data governance frameworks, policies, and procedures supporting data quality, compliance, and effective data management.
- Strong understanding of data security, including encryption, decryption, and secure data storage and transfer protocols.
- Experience using AI-assisted development tools such as GitHub Copilot, Cursor, or ChatGPT.
Nice to Have
- Experience with Databricks.
Benefits
- Healthcare benefits.
- Internet and cell phone reimbursement.
- Learning and development stipend.
- Opportunities to collaborate with and travel to the Mountain View headquarters and Bangkok site.
Skills
Apache Kafka, Python, Scala, Ml Engineering, Spark, AWS, Azure, GCP, Databricks, SQL, NoSQL, Git, Terraform, CI/CD, Data Governance
Similar jobs
Data Engineering jobs
Alpaca
Remote
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
StarTree
India
Build and operate distributed systems powering Apache Pinot’s real-time analytics platform at massive scale. The role requires strong distributed-systems expertise, end-to-end delivery ownership, and a focus on reliability, observability, and performance.
Fivetran
Bengaluru, India
Senior Software Engineer building reliable connectors and high-volume data pipelines that move customer data into warehouses. The role requires strong Java, cloud, database, distributed-systems, and technical leadership experience.
Snowflake
Pune, India
Build and operate scalable enterprise data pipelines, models, and platform infrastructure across the full data lifecycle. The role requires 5+ years of experience, strong SQL and Python, and deep expertise in Snowflake, dbt, and Airflow.
Okta
Bengaluru, India
Builds and maintains scalable data platforms and pipelines that support analytics and AI/ML systems. The role requires 5+ years of data engineering or full-stack experience, strong SQL and ETL expertise, cloud infrastructure experience, and a bachelor's degree.