# Senior Platform Engineer, Voice AI

**Company:** [Together AI](https://hotfix.jobs/companies/together-ai)
**Location:** San Francisco, CA
**Role:** DevOps / SRE
**Salary:** $200k – $260k/yr
**Experience:** 5+ years
**Skills:** TypeScript, Python, Rust, Kubernetes, Websocket, Http Streaming, Webrtc, React, Next.js, Distributed Systems
**Posted:** 2026-03-30

> Senior Platform Engineer owns real-time WebSocket/HTTP APIs and autoscaling infrastructure for voice AI workloads, ensuring low-latency reliability for production agents. Requires 5+ years in distributed systems, expertise in TypeScript/Python, and Kubernetes.

## Job Description

## Responsibilities
- Build and harden real-time WebSocket and HTTP streaming APIs for STT and TTS — including connection lifecycle management, backpressure, error handling, and reconnection, at the reliability bar needed for production voice agents.
- Design and ship autoscaling for voice model endpoints that handles bursty, real-time traffic patterns — accounting for concurrent connection limits, streaming state, and hard latency ceilings.
- Implement voice-specific API features: word-level alignment, speaker diarization in realtime, audio format flexibility (g711/mulaw for telephony, PCM, WebRTC formats), pronunciation controls, and multi-context WebSocket support.
- Build voice-specific observability — latency breakdowns, audio quality signals, and dashboards that help both the team and customers debug issues.
- Own multi-model normalization across our model partners (Cartesia, Deepgram, Rime, and others), ensuring consistent API behavior regardless of the underlying provider.
- Collaborate with the ML engineering side of the team on the interface between the API layer and the model serving stack, ensuring latency and reliability requirements are met end-to-end.
- Contribute to developer experience — API design, documentation, integration cookbooks, playground and showcasing how best-in-class voice agents are built.
- Lay the groundwork for multiple new products down the line.

## Requirements
- 5+ years of experience building large-scale, real-time distributed systems and API services.
- Deep expertise in real-time streaming infrastructure — WebSocket server architecture, Server-Sent Events, bidirectional streaming, connection multiplexing, and stateful protocol design.
- Expert-level programming in **TypeScript** and **Python**; experience with **Rust** is a plus.
- Strong distributed systems fundamentals: load balancing, autoscaling, rate limiting, and traffic shaping for latency-sensitive workloads.
- Experience with **Kubernetes** — including custom autoscalers, resource management, and health checking for stateful services.
- Strong product sense — you care about API ergonomics and think about what developers building voice apps actually need.
- Comfort working on a small, early-stage team where you'll wear multiple hats and move fast.
- Experience with audio or media protocols (**WebRTC**, g711, PCM encoding) is a strong plus.
- Familiarity with ML model serving infrastructure and how inference engines work is a plus — you'll interface with the serving layer regularly.
- Full-stack experience (**React**, **Next.js**) is a nice-to-have for contributing to developer-facing tooling.
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.

## Compensation
US base salary range: **$200,000 - $260,000** + equity + benefits.

## Similar roles

- [Senior Software Engineer, Cloud Infrastructure](https://hotfix.jobs/jobs/78aefb2b-cbc3-4660-bce1-7ac2fd28f1c0) - Decagon - San Francisco, CA - $200k – $400k/yr
- [Senior Software Engineer, Observability](https://hotfix.jobs/jobs/b857fbeb-7984-45df-bd84-c85c53858f73) - Together AI - San Francisco, CA - $200k – $280k/yr
- [Software Engineer](https://hotfix.jobs/jobs/e2716385-59d1-4fb7-9c9b-ebd5ec347f2f) - Baseten - San Francisco, CA - $200k – $380k/yr
- [Senior Software Engineer, Accelerated Delivery](https://hotfix.jobs/jobs/d6170467-5d52-4dcf-bf3d-e9475a94e8f6) - Snowflake - Menlo Park, CA - $200k – $288k/yr
- [Senior Software Engineer - Snowpark Container Service](https://hotfix.jobs/jobs/47626f55-409c-4469-9cea-906cfd5683e3) - Snowflake - Bellevue, WA - $200k – $288k/yr

**Apply:** https://hotfix.jobs/jobs/87b0529e-7aa2-4cf8-8f1e-0579adf1b8e6
**Canonical:** https://hotfix.jobs/jobs/87b0529e-7aa2-4cf8-8f1e-0579adf1b8e6