Senior engineer building autonomous analytical data systems for Unity Catalog Managed Tables, focusing on Predictive Optimization, Liquid Clustering, and large-scale storage innovations. Requires 15+ years building distributed systems and strong expertise in databases and performance optimization.
229k – 314k/yr
On-site15+ YOEBackend Engineering
About the role
Responsibilities
Design and implement next-generation autonomous analytical data systems for enterprise-grade performance
Develop storage lifecycle and background optimizations for Predictive Optimization
Create efficient storage structures and innovations for storage layout solutions in ML environments
Influence Data format and Catalog interface unification efforts
Enable strong ecosystem interoperability for ManagedTables
Solve real business needs at large scale through software engineering and collaboration with Product partners
Deliver a highly scalable, available, and interoperable architecture for Managed Tables
Perform low-level systems debugging, performance measurement, and optimization on large production clusters
Build architecture design, influence product roadmap, and take ownership of new projects
Introduce tools to enable greater automation and operability of services
Prevent and investigate production issues
Plan and lead complicated technical projects across multiple teams
Mentor and up-level engineers on the team
Requirements
15+ years of industry experience building and supporting large-scale distributed systems
Strong passion for database systems, storage systems, distributed systems, language design, or performance optimization
Experience working towards a multi-year vision with incremental deliverables
Strong foundation in algorithms and data structures with real-world application
BS/MS/PhD in Computer Science or related majors, or equivalent experience
Nice-to-Haves
Experience driving company initiatives towards customer satisfaction
Databricks is seeking a Sr. Staff Software Engineer to lead strategy and execution for observability, insights, and governance across their data and AI platform. This role involves establishing long-term technical direction, designing high-impact projects, and mentoring senior engineers.
Leads technical architecture and engineering for Lakeflow Pipelines Datasets platform, owning long-term direction for declarative pipelines, materialized views, and data infrastructure at exabyte scale. Requires 10+ years in large-scale distributed systems with deep expertise in databases, storage, or streaming.
229k – 314k/yr
On-site10+ YOEBackend Engineering
Staff Software Engineer
CartaSan Francisco, CA +3
Staff Software Engineer owns long-term technical health of business units at Carta, navigating complex problems, driving systemic improvements, and leading AI integration. Requires 10+ years experience in distributed systems with Python/Django, React, and AWS expertise.
228k – 300k/yr
On-site10+ YOEBackend Engineering
Staff Software Engineer
TinesUnited States
Lead technical direction and scale backend job processing systems and code execution engines for an intelligent workflow platform. Requires 10+ years experience with Linux systems, container runtimes, and low-level primitives in Rust or Go.
230k – 250k/yr
Remote10+ YOEBackend Engineering
Software Architect
MachinifyUnited States
Designs and implements intelligent document processing and agentic evaluation frameworks for healthcare AI platform, owning architecture from APIs to production code. Requires 10+ years experience with Python/Scala, LLM integration, and scalable systems.