Senior Software Engineer - Ingestion
Build scalable, fault-tolerant data ingestion systems for Lakeflow Connect, processing hundreds of terabytes daily across thousands of customers. The role requires 5+ years of production software engineering experience, distributed-systems expertise, and hands-on backend development.
About the job
Responsibilities
- Solve real business needs at large scale through software engineering.
- Deliver a highly scalable, available, and fault-tolerant engine processing hundreds of TB of data daily across thousands of customers.
- Perform low-level systems debugging, performance measurement, and optimization on large production clusters.
- Build architecture designs, influence the product roadmap, and take ownership of new projects.
- Use deep technical experience to help prevent and investigate production issues.
- Plan and lead complicated technical projects involving several teams.
- Break down complex problems into potential solutions, knowns, and unknowns, and de-risk them through prototyping and validation.
Requirements
- Bachelor's degree or higher in Computer Science or a related field.
- 5+ years of production-level experience with Python, Java, Scala, C++, or a similar language.
- Experience developing large-scale distributed systems from scratch.
- Hands-on experience developing and operating backend systems.
- Ability to contribute throughout project phases, from design and development through implementation and ongoing operations, with guidance from senior team members.
Nice-to-Haves
- Experience with database replication, backup, or transaction recovery at a major database vendor such as Microsoft SQL Server or Oracle.
Skills
Python, Java, Scala, C++, Distributed Systems, Database Replication, Transaction Recovery, Backend Systems, Performance Optimization, Production Operations
Similar jobs
Backend Engineering jobsLeads the architecture and scaling of distributed backend systems for AI-powered talent search, matching, and agentic workflows. Requires 7+ years of backend experience, strong cloud and data expertise, and proficiency in a modern object-oriented language.
Senior individual contributor responsible for designing, building, operating, and improving large-scale backend services, APIs, and telemetry pipelines in Go and Python. The role requires production systems ownership, distributed-systems expertise, incident leadership, mentoring, and technical design leadership.
Senior backend software engineer building and scaling Java and Spring Boot services for a global expense management platform. The role requires 4–6 years of experience with distributed systems, cloud platforms, production ownership, and AI-driven development.
Senior backend engineer designing scalable services and APIs that connect Phantom Cash to blockchain networks. The role requires Node.js/NestJS, REST API, event-driven, and distributed-systems expertise, with blockchain or fintech experience preferred.
Senior software engineer responsible for designing reliable, distributed tax remittance systems operating globally across currencies, agencies, and compliance requirements. Requires 6+ years of programming experience and strong backend architecture and distributed-systems expertise, with Python, Django, React, MongoDB, and AWS preferred.