# Engineering Manager - Forward Deployed Engineering (LLM)

**Company:** [Baseten](https://hotfix.jobs/companies/baseten)
**Location:** San Francisco, CA, New York, NY
**Role:** Engineering Management
**Salary:** $260k – $380k/yr
**Experience:** 4+ years
**Skills:** Python, LLMs, vLLM, TensorRT, Triton, Hugging Face, Ray Serve, Gpu Infrastructure, Ml Inference, Distributed Inference
**Posted:** 2026-05-08

> Leads and mentors Forward Deployed Engineers building and optimizing LLM inference for customers, while hands-on contributing to product features and customer engagements. Requires 4+ years software engineering with Python/ML expertise and 1+ year leadership.

## Job Description

## Responsibilities

**Leadership & Team Management**
- Lead, mentor, and grow a team of Forward Deployed Engineers, providing guidance on technical direction, project execution, and professional development.
- Set clear goals and ensure timely, high-quality delivery across multiple customer-facing projects involving LLM deployment and inference optimization.
- Collaborate with leadership to align team priorities with company and customer goals, balancing short-term delivery, widely varying customer priorities, and long-term technical initiatives.
- Player-coach – be a key driver on strategic product initiatives and customer engagements.

**Technical Ownership**
- Develop and maintain software systems and product features using general-purpose programming languages (**Python** preferred).
- Drive customer impact by designing, implementing, and deploying Baseten solutions end-to-end (problem framing → evaluation → production deployment → monitoring).
- Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs.
- Optimize and enhance AI/ML projects, contributing to continuous improvement of technical stack.
- Own products and customer projects end-to-end, functioning as engineer, project manager, and product manager.

## Requirements
- **Bachelor’s, Master’s, or Ph.D.** in Computer Science, Engineering, or related field.
- **4+ years** of professional software engineering experience, including **1+ year** in a leadership or mentorship capacity.
- Strong programming skills in **Python**, with production experience in building or optimizing ML inference systems.
- Proven experience with **LLMs**, inference optimization, or serving frameworks (e.g., **vLLM**, **TensorRT**, **Triton**, **Hugging Face**, **Ray Serve**).
- Familiarity with observability, profiling, and cost/performance tradeoffs in production ML systems.
- Excellent communication and collaboration skills.

## Bonus Points
- Experience leading customer-facing engineering teams or working directly with enterprise partners.
- Deep understanding of **GPU infrastructure**, distributed inference, or model compression techniques.

## Benefits
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents.
- Flexible PTO policy including company wide Winter Break.
- Paid parental leave.
- Fertility and family-building stipend through Carrot.
- Company-facilitated 401(k).
- Exposure to a variety of ML startups.

## Similar roles

- [Engineering Manager, Product](https://hotfix.jobs/jobs/8a722d90-e6aa-4ccb-b89f-2e7a699a0614) - Harvey - New York, NY - $260k – $330k/yr
- [Engineering Manager, Product](https://hotfix.jobs/jobs/e0d3eeef-bb77-4f32-8dc1-00801b6d7af0) - Harvey - San Francisco, CA - $260k – $330k/yr
- [Engineering Manager - Model Performance](https://hotfix.jobs/jobs/96a49fbd-49b3-4757-983f-d40719320379) - Baseten - San Francisco, CA - $260k – $380k/yr
- [Manager, Software Engineering](https://hotfix.jobs/jobs/08b204a0-1a8e-4bf2-b23c-6f8cf3a6c5b2) - Figma - Remote - $258k – $376k/yr
- [Manager, Software Engineering - Storage Platform](https://hotfix.jobs/jobs/3a3793f3-3772-4c0f-8d0d-7afdd4408eb7) - Figma - Remote - $258k – $376k/yr

**Apply:** https://hotfix.jobs/jobs/51279c3d-a4d8-41f6-aeed-4f95a288b3cd
**Canonical:** https://hotfix.jobs/jobs/51279c3d-a4d8-41f6-aeed-4f95a288b3cd