# Senior Technical Program Manager, Machine Learning Infrastructure

**Company:** [Cohere](https://hotfix.jobs/companies/cohere)
**Location:** Remote
**Role:** Technical Program Management
**Experience:** 5+ years
**Skills:** Machine Learning Infrastructure, Technical Program Management, Model Inference, Model Serving, Machine Learning Models, Endpoint Design, Incident Management, Root Cause Analysis, Engineering Best Practices, Program Portfolio Management
**Posted:** 2026-07-31

> Leads cross-functional programs for machine learning infrastructure, covering inference, serving, efficiency, and endpoints as Cohere scales its AI platform. The role requires 5+ years of technical program management experience, deep ML infrastructure knowledge, and the ability to operate strategically and tactically in a fast-paced environment.

## Job Description

## Responsibilities
- Manage the program portfolio covering inference, efficiency, serving, and endpoints to ensure infrastructure scales for a growing internal and external user base.
- Lead end-to-end coordination and execution across programs, collaborating with Modeling and customer-facing teams.
- Identify pain points and establish processes that enable development teams to focus on delivery while meeting internal and external model-user needs.
- Improve engineering best practices and build a culture of continuous improvement.
- Liaise with incident-management leads, ensure accurate root-cause analysis, and drive timely fixes.
- Manage overlapping projects and programs, prioritizing work against company priorities.
- Collaborate with stakeholders to set, track, and manage timelines, deliverables, budgets, and scope.
- Deliver clear, timely updates to engineering, leadership, and nontechnical teams about progress, plans, and incidents.
- Partner tactically and strategically with senior program leads to solve complex problems and drive company-level impact.

## Requirements
- 5+ years of Technical Program Management experience focused on machine learning infrastructure, including model inference, serving, efficiency, and endpoint design and implementation.
- In-depth technical knowledge of ML infrastructure design and implementation and engineering best practices.
- Experience working in chaotic, fast-paced, low-structure environments.
- Pragmatic, adaptable, execution-oriented approach with the ability to operate at both tactical and strategic levels.

## Nice-to-haves
- Hands-on technical experience and the ability to develop subject-matter expertise in internal systems.
- Experience working with machine learning teams.
- Working understanding of how machine learning models are built.

## Compensation and Benefits
- Weekly lunch stipend of $75/£75 or equivalent in local currency.
- Full health and dental benefits, including a separate mental-health budget.
- RRSP matching, 401(k), and pension scheme.
- 100% parental-leave top-up for up to 6 months for either parent.
- Annual enrichment benefits for arts and culture, fitness and wellness, quality time, and workspace improvements.
- Education and learning stipend for conferences, courses, and coaching.
- Six weeks of paid vacation (30 working days).
- Travel budget for remote employees to visit other offices and an annual company offsite.
- Coworking benefit for employees not near an office.
- $500 home-office stipend.

## Similar jobs

- [Senior Program Manager, Member Experience](https://hotfix.jobs/jobs/0af4dd48-d0b3-48d4-9705-27320bf91af4) - Chime - Remote - $138k – $190k/yr
- [Senior Delivery Manager](https://hotfix.jobs/jobs/8c5ea20d-6a85-4fef-83d1-8ad9b1350374) - Imprint - Remote - $150k – $200k/yr
- [Program Manager, Competitive Programs](https://hotfix.jobs/jobs/5c7a35db-7c15-4b6e-b1af-f0ce0c106791) - Stripe - Remote
- [Technical Program Manager](https://hotfix.jobs/jobs/6397e2f3-fc0e-4d9d-8676-c74d564b0d3e) - Sardine - Remote - $175k – $215k/yr
- [Senior Technical Program Manager - AI Platform Performance & Reliability](https://hotfix.jobs/jobs/c2ea219c-6c2f-4e2c-bb5d-da62b298ce46) - Nuro - Mountain View, CA - $160k – $241k/yr

**Apply:** https://hotfix.jobs/jobs/a03505c0-f73c-4900-970b-f5453d1a03ab
**Canonical:** https://hotfix.jobs/jobs/a03505c0-f73c-4900-970b-f5453d1a03ab