Member of Technical Staff

Leads cross-functional execution of a high-throughput inference platform, coordinating model providers, engineering, product, and compute teams. Requires production LLM or ML inference experience, strong technical judgment, and 6+ years in technical program or product management.

About the job

Responsibilities

Execute the inference platform roadmap, including request handling, rate limits and quotas, usage controls, reliability, and observability.
Coordinate model-provider onboarding, launch readiness, rollouts, and capacity integration with engineering and product teams.
Drive latency, throughput, uptime, and cost-efficiency metrics while surfacing tradeoffs.
Run model-release and optimization programs, including day-zero launches, across performance engineering, infrastructure, and product teams.
Lead cross-functional delivery of inference-stack changes from planning through launch and post-launch validation.
Build release mechanisms such as rituals, dashboards, and launch checklists.
Partner with GPU capacity and compute teams on cost, capacity, and vendor constraints.

Requirements

Strong experience in technical program management or product management for infrastructure, distributed systems, or ML/model-serving products.
Direct production experience with LLM or ML inference.
Ability to coordinate external partners and internal engineering teams with competing priorities and timelines.
Experience using data and metrics to evaluate latency, throughput, uptime, and cost tradeoffs.
Initiative, ownership, and comfort working in a small, agile team with limited precedent.
6+ years of combined technical program management or product management experience.

Skills

Technical Program Management, Product Management, Infrastructure, Distributed Systems, Machine Learning, Llm Inference, Model Serving, Performance Engineering, Observability, Gpu Computing, Metrics, Rate Limiting