Software Engineer - Database Engine Internals
Design and develop next-generation database query and storage systems, covering optimization, distributed execution, transactions, and physical data organization. The role requires 5+ years of related systems experience and values expertise in databases, distributed systems, or performance optimization.
About the job
Responsibilities
- Drive requirements clarity and design decisions for ambiguous problems.
- Produce technical design documents and project plans.
- Develop new features.
- Mentor more junior engineers.
- Test and roll out changes to production, including monitoring.
Focus Areas
- Query compilation and optimization
- Distributed query execution and scheduling
- Vectorized execution engines
- Data security
- Resource management
- Transaction coordination
- Efficient storage structures, including encodings and indexes
- Automatic physical data optimization
Requirements
- Passion for database systems, storage systems, distributed systems, language design, or performance optimization.
- Comfort working toward a multi-year vision with incremental deliverables.
- Customer-oriented approach and focus on impact.
- 5+ years of experience working in a related system.
Nice to Have
- PhD in databases or distributed systems.
Benefits
- Comprehensive benefits and perks tailored to employees' needs, with region-specific details available from Databricks.
Skills
Database Systems, Storage Systems, Distributed Systems, Query Optimization, Query Execution, Vectorized Execution, Data Security, Resource Management, Transaction Coordination, Data Indexing, Spark, Language Design, Performance Optimization
Similar jobs
Data Engineering jobs
Vanta
Remote
Own the systems that ingest, standardize, validate, and operationalize data signals for Vanta’s EPD organization. The role suits a hands-on builder who has recently shipped working tools or pipelines, uses AI-assisted development, and helps teammates grow technically.
Alpaca
Remote
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
Thyme Care
Remote
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Vanta
Remote
Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.
Vanta
Remote
Senior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.