Staff Software Engineer - Ingestion
Leads development of Lakeflow Connect’s large-scale data ingestion systems, applying database internals expertise to incremental capture and log parsing. The role requires 15+ years building distributed systems, strong algorithms and data structures knowledge, and technical leadership across complex initiatives.
About the job
Responsibilities
- Solve real business needs at large scale through software engineering.
- Deliver a highly scalable, available, and fault-tolerant engine processing hundreds of TB of data daily across thousands of customers.
- Perform low-level systems debugging, performance measurement, and optimization on large production clusters.
- Design architectures, influence product roadmaps, and own new projects.
- Use deep technical experience to help prevent and investigate production issues.
- Plan and lead complex technical projects involving several teams.
- Influence organizational roadmaps and direction.
- Lead a TLG or similar review committee, or initiate and sustain engineering-wide initiatives.
- Break down complex problems into potential solutions, knowns, and unknowns, and de-risk them through prototyping and validation.
- Mentor engineers, lead sprint planning, delegate assignments, and participate in project planning.
Requirements
- 15+ years of industry experience building and supporting large-scale distributed systems.
- Experience with database replication, backup, or transaction recovery at a major database vendor such as Microsoft SQL Server, Oracle, or IBM.
- Strong foundation in algorithms and data structures, including real-world applications.
- Ability to work toward a multi-year vision with incremental deliverables.
- Motivation to deliver customer value and impact.
- Experience driving company initiatives focused on customer satisfaction.
Skills
Distributed Systems, Database Replication, Database Backup, Transaction Recovery, Algorithms, Data Structures, Incremental Data Capture, Log Parsing, Performance Optimization, Fault-Tolerant Systems
Similar jobs
Backend Engineering jobs
GoHighLevel
India
Leads architecture and reliability for a global payments and commerce platform, shaping APIs, distributed systems, observability, compliance, and production operations. Requires 10+ years of backend experience, deep Go and distributed-systems expertise, and Staff/Principal-level technical leadership.
Rippling
Bengaluru, India
Leads architecture and hands-on development of scalable, reliable, and compliant financial integrity systems. The role requires 8+ years of software engineering experience, distributed-systems expertise, and the ability to drive complex initiatives and mentor engineers through influence.
GitLab
Bengaluru, India
Provides cross-team technical leadership for large backend initiatives, modular architecture, production operations, and AI-assisted engineering adoption. The role requires deep backend architecture experience, monolith modernization expertise, strong written influence, and mentoring ability.
Coinbase
India
Staff Software Engineer responsible for architecting and scaling security platform services, defining technical strategy, and mentoring engineers. Requires at least 8 years of software engineering experience plus strong system design, coding, and production-service expertise.
Reltio
Bengaluru, India
Staff Engineer leading design and delivery of large-scale distributed data platform features for enterprise customers. The role requires strong Java and cloud experience, architectural leadership, cross-functional collaboration, and mentorship.