Technical Program Manager, Model Deployment & Capacity

Leads cross-functional programs for Chat capacity planning and model deployment, connecting demand forecasting, serving capacity, launch readiness, rollout coordination, and post-deployment learning. Requires technical program leadership in infrastructure, distributed systems, model serving, or large-scale deployment environments.

About the job

Responsibilities

Own cross-functional programs for Chat capacity forecasting, allocation, headroom planning, and constrained-capacity operations.
Build intake, prioritization, and decision mechanisms connecting product demand and model requirements to serving capacity.
Partner with product, research, inference, fleet, and capacity teams to develop scenarios, surface tradeoffs, and drive allocation decisions.
Lead model deployment readiness and rollout planning, including capacity allocation, launch sequencing, validation, and operational handoffs.
Establish readiness gates, risk reviews, rollback criteria, and escalation paths for model deployments.
Coordinate launches through deployment and post-launch learning, converting recurring gaps and manual work into scalable tooling and operating practices.
Define and operationalize metrics for forecast accuracy, capacity utilization and headroom, deployment velocity, reliability, latency, quality, and user impact.
Create concise communications that clarify dependencies, risks, capacity constraints, and launch decisions for technical and product leaders.

Requirements

Experience leading complex technical programs in infrastructure, distributed systems, capacity planning, model serving, or large-scale deployment environments.
Ability to reason about demand, supply, headroom, reliability, latency, and quality tradeoffs and translate them into executable plans.
Experience building operating mechanisms or tooling that replace fragmented manual workflows with scalable systems and clear ownership.
Ability to operate effectively in ambiguous, capacity-constrained environments and make explicit tradeoffs.
Ability to align research, engineering, product, finance or capacity planning, and operations teams without direct authority.
Experience using metrics to guide decisions, identify bottlenecks, and demonstrate improvements in throughput, predictability, or reliability.
Precise communication skills across technical, operational, and executive audiences.

Compensation

Annual salary range: $257,000–$445,000.

Skills

Capacity Planning, Model Deployment, Distributed Systems, Infrastructure, Model Serving, Demand Forecasting, Rollout Planning, Risk Management, Metrics, Reliability, Latency, Operational Tooling