# Manager, Solutions Architect

**Company:** [Baseten](https://hotfix.jobs/companies/baseten)
**Location:** San Francisco, CA, New York, NY
**Role:** Engineering Management
**Salary:** $165k – $330k/yr
**Experience:** 4+ years
**Skills:** LLMs, AI/ML, vLLM, Sglang, Trt-Llm, GPU, H100, B200, Inference, Benchmarks, Docker, Comfyui
**Posted:** 2026-05-08

> Leads and mentors a team of Solution Architects partnering with sales to translate customer needs into technical AI solutions, run discovery, demos, POCs, and deploy high-performance LLM applications on Baseten's platform. Requires 4+ years in solutions architecture with AI/ML expertise and 1+ year leadership.

## Job Description

## Responsibilities

**Leadership**
- Lead, mentor, and grow a team of Solution Architects, providing guidance on technical direction, project execution, and professional development.
- Set clear goals and ensure timely, high-quality delivery across multiple customer-facing projects involving LLM deployment and inference optimization.
- Collaborate with leadership to align team priorities with company and customer goals, balancing short-term delivery, widely varying customer priorities, and long-term technical initiatives.
- Player-coach – drive strategic product initiatives and customer engagements hands-on when needed.

**Team Management**
- Lead team partnering with sales on customer discovery calls.
- Lead demos and technical scoping to align on success criteria, architecture, and deployment approach.
- Own benchmarking and repeatable deployments for LLMs, embeddings, image/video generation, VoiceAI, etc.
- Advise on tradeoffs like H100s vs B200s and latency-optimized vs throughput-optimized setups.
- Drive consistent “playbook” style deployments for common models and use cases.
- Become power user of runtimes such as vLLM, SGLang, TRT-LLM and configurations.
- Drive POC and project execution: scoping, stakeholder alignment, project management, pulling in FDE support.

## Requirements
- AI/ML background to discuss topics credibly with technical stakeholders.
- 4+ years professional Solution Architecture/Solutions Engineering experience, including 1+ year in leadership/mentorship.
- Strong customer-facing communication skills for structured discovery and clarifying ambiguous requirements.
- Technical depth to scope solutions without writing production code.
- Ability to script and prototype, including “vibe coding” for quick workflows.

## Nice to Have
- Experience running/supporting benchmarks for ML inference deployments.
- Familiarity with infrastructure tradeoffs for inference (GPU selection, latency vs throughput tuning).
- Experience as cross-functional technical lead for customer POCs.
- Professional software engineering experience.

## Benefits
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents.
- Flexible PTO policy including company-wide Winter Break.
- Paid parental leave.
- Fertility and family-building stipend.
- Company-facilitated 401(k).

## Similar roles

- [Engineering Manager, Internal Platform](https://hotfix.jobs/jobs/067c2314-99a7-41ff-b625-d82d1c5b9213) - Baseten - San Francisco, CA - $165k – $330k/yr
- [Engineering Manager, Model Library](https://hotfix.jobs/jobs/1b9b35fa-4ba7-4b82-8642-8e1e0020faff) - Baseten - San Francisco, CA - $165k – $330k/yr
- [AI Deployment Manager - San Francisco](https://hotfix.jobs/jobs/05d08354-5c5e-4a81-8bff-734e62df9f2f) - OpenAI - San Francisco, CA - $162k – $230k/yr
- [Engineering Manager, Linux Team](https://hotfix.jobs/jobs/a67592f2-cdb1-4d8d-9d8b-a03184ca1904) - Cloudflare - $170k – $303k/yr
- [AI Operations Manager | Agentic CX](https://hotfix.jobs/jobs/695859a6-cf0a-4c47-886f-c1da81d70297) - Ramp - New York, NY - $170k – $290k/yr

**Apply:** https://hotfix.jobs/jobs/66863627-020f-4832-90a5-dfe4ba2aa1e6
**Canonical:** https://hotfix.jobs/jobs/66863627-020f-4832-90a5-dfe4ba2aa1e6