# Engineering Manager, Model Library

**Company:** [Baseten](https://hotfix.jobs/companies/baseten)
**Location:** San Francisco, CA, New York, NY
**Role:** Engineering Management
**Salary:** $165k – $330k/yr
**Skills:** APIs, SDKs, Developer Tooling, ML Infrastructure, Model Evaluation, Inference Platforms, Llm Runtimes, Code Review, Design Review, Self-Serve Workflows
**Posted:** 2026-05-13

> Leads engineering team building Model Library for AI model discovery, evaluation, and integration tooling. Drives end-to-end product ownership, hires and mentors ICs, partners cross-functionally while staying technically hands-on in ambiguous AI environments.

## Job Description

## Responsibilities
- Lead and grow a team of engineers, including hiring, mentorship, and career development.
- Own the Model Library product area end-to-end — from discovery and evaluation experiences to the APIs and tooling developers use to integrate models.
- Partner with product, ML, and cross-functional stakeholders to define scope, prioritize work, and communicate progress.
- Maintain a high technical bar through design doc reviews, code reviews, and hands-on architectural guidance.
- Drive product quality and reliability: define success metrics, establish feedback loops, and ensure a consistent, high-quality developer experience.
- Foster a culture of strong written communication, clear design thinking, and effective collaboration.

## Requirements
- Experience managing engineers building developer-facing products: APIs, SDKs, or developer tooling.
- Product intuition and technical judgment — able to balance speed, quality, and developer experience tradeoffs.
- Technically hands-on enough to review designs, debug issues, and earn the trust of a strong IC team.
- Strong written communication and cross-functional collaboration skills.
- Interest in AI/ML and the evolving model landscape; willingness to develop deep domain knowledge (ML expertise not required).
- Experience building or supporting self-serve workflows.

## Nice to Have
- Background as an IC in developer tooling, APIs, or ML infrastructure before moving into management.
- Experience with model evaluation, benchmarking, or comparison frameworks.
- Familiarity with inference platforms, LLM runtimes, or the model ecosystem (open-source and frontier).

## Benefits
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents.
- Flexible PTO policy including company wide Winter Break (offices closed from Christmas Eve to New Year's Day).
- Paid parental leave.
- Fertility and family-building stipend through Carrot.
- Company-facilitated 401(k).
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

## Similar roles

- [Engineering Manager, Internal Platform](https://hotfix.jobs/jobs/067c2314-99a7-41ff-b625-d82d1c5b9213) - Baseten - San Francisco, CA - $165k – $330k/yr
- [Manager, Solutions Architect](https://hotfix.jobs/jobs/66863627-020f-4832-90a5-dfe4ba2aa1e6) - Baseten - San Francisco, CA - $165k – $330k/yr
- [AI Deployment Manager - San Francisco](https://hotfix.jobs/jobs/05d08354-5c5e-4a81-8bff-734e62df9f2f) - OpenAI - San Francisco, CA - $162k – $230k/yr
- [Engineering Manager, Linux Team](https://hotfix.jobs/jobs/a67592f2-cdb1-4d8d-9d8b-a03184ca1904) - Cloudflare - $170k – $303k/yr
- [AI Operations Manager | Agentic CX](https://hotfix.jobs/jobs/695859a6-cf0a-4c47-886f-c1da81d70297) - Ramp - New York, NY - $170k – $290k/yr

**Apply:** https://hotfix.jobs/jobs/1b9b35fa-4ba7-4b82-8642-8e1e0020faff
**Canonical:** https://hotfix.jobs/jobs/1b9b35fa-4ba7-4b82-8642-8e1e0020faff