Senior Technical Program Manager, Machine Learning Infrastructure

Leads cross-functional programs for machine learning infrastructure, covering inference, serving, efficiency, and endpoints as Cohere scales its AI platform. The role requires 5+ years of technical program management experience, deep ML infrastructure knowledge, and the ability to operate strategically and tactically in a fast-paced environment.

About the job

Responsibilities

Manage the program portfolio covering inference, efficiency, serving, and endpoints to ensure infrastructure scales for a growing internal and external user base.
Lead end-to-end coordination and execution across programs, collaborating with Modeling and customer-facing teams.
Identify pain points and establish processes that enable development teams to focus on delivery while meeting internal and external model-user needs.
Improve engineering best practices and build a culture of continuous improvement.
Liaise with incident-management leads, ensure accurate root-cause analysis, and drive timely fixes.
Manage overlapping projects and programs, prioritizing work against company priorities.
Collaborate with stakeholders to set, track, and manage timelines, deliverables, budgets, and scope.
Deliver clear, timely updates to engineering, leadership, and nontechnical teams about progress, plans, and incidents.
Partner tactically and strategically with senior program leads to solve complex problems and drive company-level impact.

Requirements

5+ years of Technical Program Management experience focused on machine learning infrastructure, including model inference, serving, efficiency, and endpoint design and implementation.
In-depth technical knowledge of ML infrastructure design and implementation and engineering best practices.
Experience working in chaotic, fast-paced, low-structure environments.
Pragmatic, adaptable, execution-oriented approach with the ability to operate at both tactical and strategic levels.

Nice-to-haves

Hands-on technical experience and the ability to develop subject-matter expertise in internal systems.
Experience working with machine learning teams.
Working understanding of how machine learning models are built.

Compensation and Benefits

Weekly lunch stipend of $75/£75 or equivalent in local currency.
Full health and dental benefits, including a separate mental-health budget.
RRSP matching, 401(k), and pension scheme.
100% parental-leave top-up for up to 6 months for either parent.
Annual enrichment benefits for arts and culture, fitness and wellness, quality time, and workspace improvements.
Education and learning stipend for conferences, courses, and coaching.
Six weeks of paid vacation (30 working days).
Travel budget for remote employees to visit other offices and an annual company offsite.
Coworking benefit for employees not near an office.
$500 home-office stipend.

Skills

Machine Learning Infrastructure, Technical Program Management, Model Inference, Model Serving, Machine Learning Models, Endpoint Design, Incident Management, Root Cause Analysis, Engineering Best Practices, Program Portfolio Management