Skip to content

Technical Program Manager, AI Infrastructure

220k – 260kRedwood City, CATechnical Program ManagementHybrid5+ YOE
Summary

Leads high-impact AI infrastructure programs for model training, evaluation, and serving at scale. Partners with engineering, research, and product teams to align roadmaps, drive execution, track metrics, and optimize workflows in technically complex environments. Requires 5-8 years experience in technical program management.

About the role

What You’ll Do

  • Lead planning and execution of major AI infrastructure initiatives spanning training pipelines, data systems, model evaluation, and inference/serving
  • Build structures that keep teams aligned: scopes, goals, requirements, timelines, risks, and success metrics
  • Partner with engineering, research, and product to translate model and product needs into infrastructure roadmaps and priorities
  • Drive cross-functional accountability and communication across teams working on tightly coupled systems
  • Track key infrastructure metrics (e.g., reliability, latency, throughput, cost efficiency) and define reporting that surfaces progress and risk
  • Identify bottlenecks in infrastructure workflows and lead efforts to improve tooling, automation, and developer velocity
  • Support capacity planning and resource allocation to ensure infrastructure scales with model and product growth
  • Develop repeatable frameworks and operational patterns that improve execution quality across infrastructure programs
  • Serve as a strategic partner to leaders on prioritization, sequencing, and tradeoffs across infrastructure investments
  • Work closely with AI cloud providers and serve as the primary bridge between internal engineering teams and external partnership efforts
  • Technical understanding of GPU clusters, AI accelerator chips, and cloud providers to effectively evaluate requirements and guide infrastructure decisions

What You’ll Bring

  • 5–8 years of experience in program management, technical operations, or product execution in a fast-moving, technical environment
  • Proven ability to lead complex, multi-team initiatives spanning engineering and infrastructure systems
  • Strong communication skills with the ability to bridge technical and non-technical stakeholders
  • Experience working closely with engineering teams on distributed systems, cloud infrastructure, or platform development
  • Ability to break down ambiguous problem spaces into clear plans and drive alignment across teams
  • Analytical mindset with experience using data to inform decisions and measure impact
  • Strong ownership and execution mindset, with the ability to manage multiple priorities simultaneously
Skills
GPU clustersAI accelerator chipscloud providersdistributed systemscloud infrastructureplatform developmenttraining pipelinesdata systemsmodel evaluationinference/serving
Similar roles at this salary range
All Technical Program Management jobs →
Instacart

Senior Technical Program Manager, Enterprise

Lead complex, high-visibility engineering programs that evolve Instacart's Enterprise platform for retailers. Own end-to-end execution across Engineering, Product, Data Science, and Business Development teams.

178k – 226kUnited StatesTechnical Program ManagementRemote5+ YOERisk ManagementProgram Strategy
Pinterest

Director, Technical Program Management

Lead the Technical Program Management function for Pinterest’s Ads Quality & Measurement organization, driving company-level programs across ranking, relevance, measurement, and marketplace quality. Set strategy, own metrics frameworks, and manage a team of senior TPMs to deliver cross-org initiatives that improve advertiser performance and Pinner experiences.

193k – 397kSan Francisco, CATechnical Program ManagementHybrid10+ YOEAIAds Systems
Mercury

Head of Technical Program Management - Banking

Lead technical program management for Mercury's bank charter and governance initiatives. Own cross-functional programs spanning engineering, product, design, and data teams while building the TPM operating system and leading a team of TPMs.

243k – 337kSan Francisco, CA +2Technical Program ManagementHybrid10+ YOEFintechGovernance
Coinbase

Technical Program Manager, CX Intelligence & AI

Lead Technical Program Manager driving AI-powered CX transformation at Coinbase. Owns cross-functional execution across CX Ops, Product, Engineering, and Analytics for agent tooling, automation, and intelligence initiatives.

212k – 250kUnited StatesTechnical Program ManagementRemote10+ YOELookerSnowflake
Datadog

Director, Technical Program Management

Lead the Technical Solutions Operations PMO, owning end-to-end program delivery, operating models, and AI-driven capabilities that scale across a large customer-facing technical organization. Drive measurable business outcomes and develop a high-performing TPM team.

210k – 310kBoston, MA +2Technical Program ManagementHybrid10+ YOEPMO OperationsTeam Leadership