# Technical Program Manager, Model Performance

**Company:** [Baseten](https://hotfix.jobs/companies/baseten)
**Location:** San Francisco, CA, Toronto, Canada, New York, NY, Montreal, Canada
**Role:** Technical Program Management
**Salary:** $165k – $330k/yr
**Skills:** Technical Program Management, Model Performance, Inference Optimization, vLLM, Tensorrt-Llm, Sglang, Nvidia Dynamo, Model Releases, Deep Learning, Software Engineering, Production Serving
**Posted:** 2026-08-29

> Build and lead the Model Performance organization’s technical program framework, coordinating model releases, inference optimization, and cross-functional execution. The role requires deep technical program management experience and credibility with model-serving and performance engineering teams.

## Job Description

## Responsibilities
- Own execution across the Model Performance project portfolio, allowing technical leads to focus on technical direction.
- Design and establish planning structures, operating cadences, and status-reporting mechanisms.
- Coordinate model release and optimization programs end to end, including day-zero launches and sequencing work across performance engineering, infrastructure, and release stakeholders.
- Drive cross-team alignment as scope expands from Model Performance Core into Model APIs and the inference production stack.
- Surface risks and dependencies early and keep leadership informed with clear, accurate status.
- Partner with engineering leads to design team structures and ownership boundaries as the organization scales.

## Requirements
- Deep technical program management experience running programs of comparable scope and complexity.
- Experience program-managing model performance or inference optimization work.
- Working knowledge of production serving engines and frameworks such as vLLM, TensorRT-LLM, SGLang, or NVIDIA Dynamo.
- Experience building zero-to-one program structures in ambiguous environments.
- Ability to influence engineers, managers, and leadership without direct authority.
- Excellent written and verbal communication skills, including the ability to explain highly technical programs to varied audiences.
- High-agency decision-making, ownership, accountability, and execution.

## Nice to have
- Experience coordinating model release programs, including day-zero launches for large-scale models.
- Prior hands-on software engineering experience.
- Deep learning performance optimization experience in training or inference, preferably inference.

## Compensation and benefits
- Salary range: $165,000-$330,000, plus meaningful equity.
- Medical, dental, and vision insurance fully covered for employees and dependents.
- Flexible paid time off, including a company-wide winter break.
- Paid parental leave.
- Fertility and family-building stipend.
- Company-facilitated 401(k).

## Similar jobs

- [Subcontracts Manager, Public Sector](https://hotfix.jobs/jobs/49edfe67-9116-416a-b30c-694580ba380d) - Scale AI - Washington, DC - $166k – $249k/yr
- [Technical Program Manager , Public Sector](https://hotfix.jobs/jobs/b90a1f19-c6fe-4f75-8c3c-9f1d20aedc1f) - Scale AI - Colorado Springs, CO - $166k – $249k/yr
- [Strategic Program Manager, Information Security](https://hotfix.jobs/jobs/71e86429-b6ca-421f-9433-25f3ff31e2f1) - Figma - Remote - $169k – $296k/yr
- [Technical Program Manager, Infrastructure Delivery](https://hotfix.jobs/jobs/6f7b4ea2-8645-4852-a309-a243cc213e91) - Lightning AI - New York, NY - $160k – $220k/yr
- [Technical Program Manager](https://hotfix.jobs/jobs/ae9358eb-71a3-4b4f-abd5-6ccd8b7356d2) - Decagon - New York, NY - $160k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/4eba1155-9918-4c04-abdc-6d885ac09c73
**Canonical:** https://hotfix.jobs/jobs/4eba1155-9918-4c04-abdc-6d885ac09c73