Skip to content
DatabricksDatabricksMountain View, CA

Engineering Manager - Pipelines Engine

Lead Pipelines Engine team building next-gen ETL features and Agentic Data Engineering infrastructure for Databricks Lakeflow platform. Requires 3+ years managing engineering teams and 5+ years in data infrastructure like Apache Spark.

190k – 261k
On-siteEngineering Management

About the role

Responsibilities

  • Lead engineering team building next-generation ETL features for Databricks Lakeflow platform.
  • Oversee recruitment of top-tier talent and upskilling team members.
  • Build processes to implement product vision, strategy, organizational goals, and priorities.
  • Build high-quality, easy-to-operate software.
  • Manage technical debt, long-term technical architecture, and balance product roadmap.

Requirements

  • Minimum 3 years managing top-tier engineering teams.
  • 5+ years building data infrastructure systems (e.g., Apache Spark or database internals).
  • Passion for database systems, storage systems, distributed systems, or performance optimization.
  • Experience working with product management and customers to understand needs.
  • Ensure team builds high-quality, reliable infrastructure; responsible for testing, quality, SLAs in complex domains like distributed data systems.
  • Expertise in attracting, hiring, and coaching engineers to Databricks standards; up-leveling teams.

Skills

SparkETLDistributed SystemsData InfrastructureDatabase SystemsStorage SystemsPerformance OptimizationLakeflowSpark Declarative PipelinesGenie Code

Similar roles

Engineering Management jobs
1Password

Engineering Manager, Managed Credentials

1PasswordUnited States

Engineering Manager to lead a high-visibility team building Managed Credentials and MSP features into 1Password's enterprise password manager. Guide fullstack development, set technical vision, drive execution and scaling, coach engineers, and recruit talent in a remote environment.

190k – 278k
Remote5+ YOEEngineering Management
Commure

Engineering Manager, R&D

CommureMountain View, CA

Lead and grow an R&D engineering team building AI-native healthcare platforms. Own technical execution from research to production, manage resources, and coach engineers on backend and frontend systems.

190k – 230k
Hybrid5+ YOEEngineering Management
1Password

Engineering Manager, Authentication Services

1PasswordUnited States

Manage the Authentication Services engineering team responsible for secure authentication experiences, sign-in, and identity verification services. Drive technical vision, execution, hiring, and team scaling in a remote-first environment.

190k – 278k
Remote5+ YOEEngineering Management
Steno

Engineering Manager

StenoUnited States

Lead and develop a team of engineers, maintain technical standards, manage projects and resources, and drive continuous improvement of SDLC processes in a remote-first environment.

190k – 230k
Remote5+ YOEEngineering Management
Headway

Engineering Manager

HeadwayNew York, NY

Lead an engineering team building critical insurance platform infrastructure at Headway. Own technical direction, hiring, and cross-functional coordination for systems handling payer communication, benefits, and claims.

190k – 238k
On-site5+ YOEEngineering Management