Data Engineer
Build and own OnePay’s data infrastructure, streaming transformation pipelines, and reporting systems while partnering with engineering, product, compliance, support, analytics, and data science teams. The role requires 5+ years of experience with Databricks, Spark, Scala, Python, SQL, low-latency pipelines, and AWS.
About the job
Responsibilities
- Build and maintain OnePay's data infrastructure.
- Develop and own OnePay's streaming data transformation pipeline.
- Manage and support reporting and analytics tools.
- Collaborate closely with Data Analysts and Data Scientists.
- Track and define performance metrics.
- Perform additional duties as assigned by the manager.
Requirements
- 5+ years of experience.
- Experience with Databricks, Apache Spark, Scala, Python, and SQL.
- Experience designing and implementing low-latency data pipelines using Spark Structured Streaming.
- Experience optimizing SQL queries and lake or warehouse data structures.
- Cost-conscious creative problem-solving skills.
- Proficiency in AWS cloud services and technologies.
- Experience building, shipping, and growing non-trivial products and services.
- Passion for quality in code, communication, and culture.
- Desire to continue growing skills and ability to learn quickly.
Tools and Technologies
- Node.js and TypeScript on the server.
- NestJS and microservice-oriented architecture.
- Kubernetes and AWS.
- React Native for iOS, Android, and web platforms.
- Claude Code or Cursor for AI-assisted development.
Compensation and Benefits
- Competitive salary, stock options, and benefits from Day 1.
- Comprehensive health, accident, disability, and term life insurance.
- Mental health support and wellness programs.
- Hybrid work model with three days per week in the Bengaluru office.
- Vacation, sick leave, other paid leaves, and paid regional holidays.
- Monthly transport and work-from-home allowances.
- High-growth, mission-driven, inclusive culture.
Skills
Databricks, Spark, Scala, Python, SQL, Spark Structured Streaming, AWS, Kubernetes, Node.js, TypeScript, Nestjs, React Native
Similar jobs
Data Engineering jobs
Vanta
Remote
Own the systems that ingest, standardize, validate, and operationalize data signals for Vanta’s EPD organization. The role suits a hands-on builder who has recently shipped working tools or pipelines, uses AI-assisted development, and helps teammates grow technically.
Alpaca
Remote
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
StarTree
India
Build and operate distributed systems powering Apache Pinot’s real-time analytics platform at massive scale. The role requires strong distributed-systems expertise, end-to-end delivery ownership, and a focus on reliability, observability, and performance.
Earnin
Bengaluru, India
Senior data platform engineer who scales infrastructure, automates data delivery, builds AI-enabled analytical tools, and leads cross-functional engineering initiatives. Requires 4+ years of data infrastructure experience, strong Kafka and distributed-systems expertise, and proficiency in Python, Scala, cloud platforms, and Terraform.
Fivetran
Bengaluru, India
Senior Software Engineer building reliable connectors and high-volume data pipelines that move customer data into warehouses. The role requires strong Java, cloud, database, distributed-systems, and technical leadership experience.