# Lead Data Platform Engineer - Enterprise, Data & AI

**Company:** [Zoox](https://hotfix.jobs/companies/zoox)
**Location:** Foster City, CA
**Role:** Data Engineering
**Salary:** $230k – $277k/yr
**Experience:** 10+ years
**Skills:** Data Platforms, Data Engineering, Databricks, Aws Emr, CI/CD, RBAC, IAM, Active Directory, Data Governance, Data Quality, Terraform, Amazon Eks, LLMs, Generative AI, Query Optimization
**Posted:** 2026-09-04

> Leads the architecture, scaling, security, governance, and cost optimization of enterprise and AI data platforms. Requires 10+ years of data or software engineering experience, with expertise in production data foundations, CI/CD, governance, security, and performance optimization.

## Job Description

## Responsibilities
- Architect, optimize, scale, and own an enterprise and AI data platform and high-throughput data fabric.
- Build scalable data infrastructure and autonomous, self-healing pipelines that handle schema evolution, detect anomalies, execute circuit breakers, and recover from failures.
- Define and enforce data governance, access controls, automated data-quality testing, schema-evolution policies, and metadata management.
- Implement storage lifecycle strategies, resource throttling, and query optimization for high-throughput, low-latency analytics and AI workloads.
- Optimize Databricks and AWS EMR environments for cost and performance.
- Build CI/CD deployment templates, environment isolation, testing frameworks, version-control standards, rollback mechanisms, and automated deployment testing.
- Establish security standards, RBAC, IAM roles, fine-grained data masking, audit controls, and data-retention policies.
- Develop observability and alerting for data platforms.

## Requirements
- 10+ years of hands-on experience in data platform engineering or software engineering.
- Proven experience architecting and scaling production-grade data foundations.
- Deep expertise in performance and query tuning, compute-resource allocation, and compute-storage lifecycle policies.
- Experience with enterprise security, RBAC, Active Directory/IAM roles, data masking, compliance controls, audit trails, and data retention.
- Experience establishing data governance frameworks, schema-evolution controls, data-quality audits, and near-real-time observability.
- Hands-on experience building CI/CD pipelines, environment isolation, version control, rollback mechanisms, and automated deployment testing for data assets.

## Nice-to-Haves
- Experience incorporating LLMs or generative AI into pipeline operations, including code generation, triage, root-cause analysis, reconciliation, backfills, or anomaly detection.
- Infrastructure-as-code experience with Terraform.
- Containerization and orchestration experience with EKS.
- GPU/CPU performance optimization and utilization experience.
- Experience in autonomous vehicles, robotics, or high-tech manufacturing.

## Similar jobs

- [Senior Data Engineer](https://hotfix.jobs/jobs/8fa75910-7872-42b1-b79f-9939f03c2318) - Garner Health - New York, NY - $220k – $245k/yr
- [Senior Database Reliability Engineer](https://hotfix.jobs/jobs/cc2c14f6-9532-42d5-89b2-55071c1e06c4) - Prompt Health - Remote - $220k – $240k/yr
- [Analytics Engineering Manager](https://hotfix.jobs/jobs/389b68c7-35ae-41d3-96c4-5c9e848ab653) - OnePay - Remote - $220k – $260k/yr
- [Senior Software Engineer, Data Infrastructure](https://hotfix.jobs/jobs/2c3e5efe-6f60-4a27-b7ec-1795674ea20d) - Decagon - San Francisco, CA - $200k – $400k/yr
- [Senior Software Engineer, Data Platform](https://hotfix.jobs/jobs/49af38a0-1567-4b29-b4cd-abc6eb545270) - Discord - Remote - $196k – $245k/yr

**Apply:** https://hotfix.jobs/jobs/208fa17a-1c41-4472-8810-13a7f9492d1f
**Canonical:** https://hotfix.jobs/jobs/208fa17a-1c41-4472-8810-13a7f9492d1f