Senior Software Engineer
Designs and develops large-scale data applications and pipelines using Java, Spark, Scala, Kafka, Hadoop, and AWS. Requires at least six years of Java development experience focused on data engineering and streaming platforms.
About the job
Responsibilities
- Design, develop, document, and architect big data applications in collaboration with product owners, developers, DevOps, and QA.
- Apply an end-to-end quality mindset to ensure stability and performance.
- Design, develop, and manage data pipelines.
- Develop MapReduce code for Hadoop clusters.
Requirements
- 6+ years of Java development experience with streaming platforms such as Spark, Scala, and Kafka.
- Experience developing MapReduce code for Hadoop clusters.
- Exposure to a NoSQL database.
- Extensive experience with cloud technologies such as AWS.
- Background in data engineering and Java development.
Skills
Java, Spark, Scala, Apache Kafka, Mapreduce, Hadoop, NoSQL, AWS, Data Pipelines, Big Data
Similar jobs
Data Engineering jobs
Alpaca
Remote
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
StarTree
India
Build and operate distributed systems powering Apache Pinot’s real-time analytics platform at massive scale. The role requires strong distributed-systems expertise, end-to-end delivery ownership, and a focus on reliability, observability, and performance.
Earnin
Bengaluru, India
Senior data platform engineer who scales infrastructure, automates data delivery, builds AI-enabled analytical tools, and leads cross-functional engineering initiatives. Requires 4+ years of data infrastructure experience, strong Kafka and distributed-systems expertise, and proficiency in Python, Scala, cloud platforms, and Terraform.
Fivetran
Bengaluru, India
Senior Software Engineer building reliable connectors and high-volume data pipelines that move customer data into warehouses. The role requires strong Java, cloud, database, distributed-systems, and technical leadership experience.
Snowflake
Pune, India
Build and operate scalable enterprise data pipelines, models, and platform infrastructure across the full data lifecycle. The role requires 5+ years of experience, strong SQL and Python, and deep expertise in Snowflake, dbt, and Airflow.