Skip to content
SkillableSkillableUnited States

Manager, Data Engineering

Lead and manage a team of 5+ data engineers to build and operate Skillable's enterprise data platform. Drive Medallion architecture implementation using Databricks, dbt, Boomi, and Delta Lake while establishing DataOps practices and improving pipeline reliability.

140k – 185k/yr
Remote10+ YOEData Engineering

About the role

Responsibilities

  • Manage a team by hiring and onboarding talent, setting clear expectations, conducting formal performance reviews, and coaching accountability.
  • Lead the team to deliver on the enterprise data platform roadmap by translating architecture direction into sequenced execution plans, team backlogs, and measurable outcomes.
  • Create a strong engineering culture across the team by setting standards for maintainability, organization, and repeatability; growing engineers via regular 1:1s, timely feedback, development plans, and formal review cycles.
  • Own day-to-day execution for the Data Engineering team by breaking work into tasks, driving sprint-level planning, delegating effectively, unblocking delivery, and ensuring high-quality outcomes through engineering reviews.
  • Drive implementation of the Medallion architecture (Bronze → Silver → Gold) with strong enforcement of layer responsibilities, leveraging Boomi, dbt, Azure Databricks, Rivery, Delta tables, and SQL Server.
  • Partner closely with the Data Architect to bring the architecture to life through concrete implementation patterns and guardrails.
  • Establish DataOps practices aligned with modern SDLC: CI/CD for data assets, consistent branching/release patterns, code review standards, and runbooks.
  • Improve pipeline observability and operational reliability by implementing monitoring for freshness/staleness, failure modes, and quality signals.
  • Drive stakeholder partnership and intake stream: collaborate with business partners to clarify requirements and shape requests into deliverable work.

Requirements

  • Bachelor’s degree in Computer Science, Data Science, Engineering, or relevant professional experience.
  • 10+ years of relevant professional experience in software / data engineering, including building production data pipelines and data platforms.
  • 2+ years of experience in lead capacity including team leadership, task breakdown, reviews, and cross-functional coordination.
  • Experience directly managing a team, including hiring/interviewing and conducting formal performance reviews.
  • Deep hands-on experience with Databricks (Spark), Boomi/Rivery, and Delta Lake patterns for scalable lakehouse processing.
  • Strong experience with ETL/ELT design and implementation, including orchestration/ingestion into transformation workflows.
  • Experience partnering with application and database teams to define efficient data access patterns for upstream SQL Server systems (read replicas, CDC, snapshot isolation).
  • Demonstrated expertise implementing Medallion architecture with clear separation of concerns across Bronze/Silver/Gold.
  • Strong understanding of ingestion/source variability (APIs, CDC-enabled databases, file drops).
  • Track record of improving team maturity from reactive delivery to repeatable engineering execution.
  • Experience working cross-functionally and promoting collaborative partnerships.
  • Proven ability to communicate effectively to various audiences/levels.

Nice-to-Haves

  • Experience working in a fully remote team.
  • Thorough understanding of business operations and processes.
  • Strong Microsoft suite experience, including Teams or similar web conferencing tools.

Compensation & Benefits

  • Base salary: $140,000 - $185,000 annually.
  • Fully remote with a monthly stipend to pay for office services and supplies.
  • Medical (2 plan options), dental, and vision insurance.
  • 401(k) with company match.
  • Unlimited PTO.
  • Paid parental leave.
  • Monthly wellness stipend.
  • Professional development budget.

Skills

DatabricksSparkDelta LakedbtBoomiRiverySQL ServerETLELTMedallion ArchitectureDataopsCI/CDCdc
Actively AI

Senior/Staff Software Engineer (Data Platform)

Actively AISan Francisco, CA

Builds and scales data pipelines, transformations, and infrastructure powering real-time AI agents. Handles ingestion from CRM, transcripts, and signals into agent-ready data, ensuring freshness, reliability, and low-latency at scale for millions of accounts. Requires 5+ years in data systems.

140k – 210k/yr
On-site5+ YOEData Engineering
Shield AI

Staff Engineer, Operations Analysis (R4757)

Shield AIDallas, TX +1

Performs modeling, simulation, and operational analysis of AI-powered autonomous aircraft systems to evaluate performance, survivability, and mission impact in military scenarios. Requires 7+ years in defense/aerospace analysis, Bachelor's in STEM, and US security clearance.

150k – 220k/yr
On-site7+ YOEData Engineering
Pinterest

Staff Data Engineer, tvScientific

PinterestSan Francisco, CA

Lead design and implementation of scalable identity resolution and data governance platforms. Build pipelines for identity data management, ensure privacy compliance, and partner with teams to deliver reliable data services. Requires 5+ years Spark/Scala experience.

156k – 320k/yr
Remote5+ YOEData Engineering
Actively AI

Senior/Staff Software Engineer (Data Platform)

Actively AINew York, NY

Builds and scales data pipelines and infrastructure powering real-time AI agents, handling ingestion from CRM, transcripts, and signals into clean representations. Requires 5+ years in data systems, proficiency in Python/SQL/DBT/warehouse tech, and real-time streaming experience.

120k – 220k/yr
On-site5+ YOEData Engineering
Nuro

Senior/Staff Software Engineer, ML Data Infrastructure

NuroMountain View, CA

Builds scalable data infrastructure for ML training and evaluation in autonomous driving, including pipelines for logs, annotation tools, dashboards, and monitoring systems. Requires Python proficiency, 1+ years experience with large-scale data systems, and CS/EE bachelor's degree.

160k – 241k/yr
On-siteData Engineering