# Senior Machine Learning Engineer, Voice AI

**Company:** [Together AI](https://hotfix.jobs/companies/together-ai)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $200k – $260k/yr
**Experience:** 5+ years
**Skills:** PyTorch, Python, Tensorrt-Llm, vLLM, Sglang, CUDA, Whisper, Trt-Llm, Snac, Gpu Optimization
**Posted:** 2026-03-30

> Senior ML Engineer optimizes inference for voice AI models (STT, TTS, speech-to-speech) using engines like TensorRT-LLM and SGLang on GPUs. Requires 5+ years ML engineering with serving/inference expertise, Python/PyTorch proficiency, and production ML experience.

## Job Description

## Responsibilities
- Optimize inference performance for voice models (STT, TTS, speech-to-speech) — targeting best-in-class TTFB, throughput, and GPU utilization across curated model set.
- Productionize voice models on serverless and dedicated endpoints, including batching strategies, streaming inference, and memory management tailored to audio workloads.
- Build and maintain a voice model evaluation framework — measuring WER across accents, languages, and noise conditions for STT; naturalness, latency, and pronunciation accuracy for TTS.
- Enable new model architectures in serving stack as field evolves, including audio-native LLMs, codec-based models (SNAC), and speech-to-speech systems.
- Collaborate with model partners to integrate and optimize their models (Cartesia, Deepgram, Rime, and others) running on Together's infrastructure.
- Profile and debug performance across full inference stack — from GPU kernels to framework-level bottlenecks — and ship measurable improvements.
- Work with platform engineering to ensure serving layer meets latency and reliability requirements of real-time voice APIs.
- Contribute to voice model fine-tuning capabilities (STT and TTS) as customers build differentiated voice experiences.
- Lay groundwork for multiple new products.

## Requirements
- 5+ years of experience in ML engineering, with focus on model serving, inference optimization, or ML infrastructure.
- Hands-on experience with LLM serving engines (**vLLM**, **SGLang**, **TensorRT-LLM**, or similar) — comfortable reading and modifying engine internals.
- Strong proficiency in **Python** and **PyTorch**; experience with GPU profiling and optimization (**CUDA**, memory management, kernel-level debugging).
- Track record of shipping ML systems to production with measurable performance improvements.
- Strong product sense — understanding developer needs for voice apps.
- Comfort working on small, early-stage team, wearing multiple hats and moving fast.

## Nice-to-Haves
- Experience with speech and audio ML (ASR, TTS architectures, audio signal processing).
- Familiarity with audio codecs and tokenization schemes (**SNAC**, **Encodec**, **DAC**).
- Experience training or fine-tuning speech models.
- Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field, or equivalent practical experience.

## Compensation
US base salary range: **$200,000 - $260,000** + equity + benefits.

## Similar roles

- [Senior Machine Learning Engineer, Relevance and Personalization](https://hotfix.jobs/jobs/589feee3-05a3-4944-84df-8bd20d220687) - Airbnb - Remote - $200k – $235k/yr
- [Senior Software Engineer](https://hotfix.jobs/jobs/d09d15d2-e8db-4410-8432-411e1731679e) - Traba - New York, NY - $200k – $240k/yr
- [Senior Applied AI Engineer](https://hotfix.jobs/jobs/2ee355ea-77df-4a9a-bab1-4a96c2ed3514) - Roger Healthcare - San Francisco, CA - $200k – $250k/yr
- [Senior Software Engineer, Build](https://hotfix.jobs/jobs/f9da1ebf-fa44-456b-84fa-e08ad0706de2) - Astronomer - New York, NY - $200k – $230k/yr
- [Senior Software Engineer — LLM Post-Training Platform](https://hotfix.jobs/jobs/18eb951a-f28d-45af-bc44-7a715505e791) - Snowflake - Bellevue, WA - $200k – $288k/yr

**Apply:** https://hotfix.jobs/jobs/dae715a5-cc5a-4a91-97df-1d6e9bd42baf
**Canonical:** https://hotfix.jobs/jobs/dae715a5-cc5a-4a91-97df-1d6e9bd42baf