Staff Software Engineer - Ingestion
Leads hands-on development of a highly scalable Lakeflow Connect ingestion engine, extracting data from OLTP systems with minimal production impact. The role requires deep database internals expertise, distributed systems experience, technical leadership, and 15+ years of industry experience.
About the job
Responsibilities
- Solve real business needs at large scale through software engineering.
- Deliver a highly scalable, available, and fault-tolerant engine processing hundreds of terabytes of data daily across thousands of customers.
- Perform low-level systems debugging, performance measurement, and optimization on large production clusters.
- Design architectures, influence product roadmaps, and own new projects.
- Prevent and investigate production issues using deep technical experience.
- Plan and lead complex technical projects involving multiple teams.
- Influence or drive organizational roadmaps and direction.
- Lead a TLG or similar review committee, or initiate and sustain engineering-wide initiatives.
- Break down complex problems into potential solutions, knowns, and unknowns, and de-risk them through prototyping and validation.
- Contribute as a Technical Team Lead by mentoring engineers, leading sprint planning, delegating assignments, and participating in project planning.
Requirements
- 15+ years of industry experience building and supporting large-scale distributed systems.
- Experience with database replication, backup, or transaction recovery at a major database vendor such as Microsoft SQL Server, Oracle, or IBM.
- Ability to work toward a multi-year vision with incremental deliverables.
- Motivation to deliver customer value and business impact.
- Strong foundation in algorithms and data structures, including real-world applications.
- Experience driving company initiatives focused on customer satisfaction.
Benefits and Compensation
- Comprehensive regional benefits and perks are offered to employees.
Skills
Distributed Systems, Database Replication, Database Backup, Transaction Recovery, Algorithms, Data Structures, Incremental Data Capture, Log Parsing, Performance Optimization, Systems Debugging
Similar jobs
Backend Engineering jobs
GoHighLevel
India
Leads architecture and reliability for a global payments and commerce platform, shaping APIs, distributed systems, observability, compliance, and production operations. Requires 10+ years of backend experience, deep Go and distributed-systems expertise, and Staff/Principal-level technical leadership.
Rippling
Bengaluru, India
Leads architecture and hands-on development of scalable, reliable, and compliant financial integrity systems. The role requires 8+ years of software engineering experience, distributed-systems expertise, and the ability to drive complex initiatives and mentor engineers through influence.
GitLab
Bengaluru, India
Provides cross-team technical leadership for large backend initiatives, modular architecture, production operations, and AI-assisted engineering adoption. The role requires deep backend architecture experience, monolith modernization expertise, strong written influence, and mentoring ability.
Coinbase
India
Staff Software Engineer responsible for architecting and scaling security platform services, defining technical strategy, and mentoring engineers. Requires at least 8 years of software engineering experience plus strong system design, coding, and production-service expertise.
Reltio
Bengaluru, India
Staff Engineer leading design and delivery of large-scale distributed data platform features for enterprise customers. The role requires strong Java and cloud experience, architectural leadership, cross-functional collaboration, and mentorship.