Senior Platform Engineer owns real-time WebSocket/HTTP APIs and autoscaling infrastructure for voice AI workloads, ensuring low-latency reliability for production agents. Requires 5+ years in distributed systems, expertise in TypeScript/Python, and Kubernetes.
200k – 260k/yr
On-site5+ YOEDevOps / SRE
About the role
Responsibilities
Build and harden real-time WebSocket and HTTP streaming APIs for STT and TTS — including connection lifecycle management, backpressure, error handling, and reconnection, at the reliability bar needed for production voice agents.
Design and ship autoscaling for voice model endpoints that handles bursty, real-time traffic patterns — accounting for concurrent connection limits, streaming state, and hard latency ceilings.
Implement voice-specific API features: word-level alignment, speaker diarization in realtime, audio format flexibility (g711/mulaw for telephony, PCM, WebRTC formats), pronunciation controls, and multi-context WebSocket support.
Build voice-specific observability — latency breakdowns, audio quality signals, and dashboards that help both the team and customers debug issues.
Own multi-model normalization across our model partners (Cartesia, Deepgram, Rime, and others), ensuring consistent API behavior regardless of the underlying provider.
Collaborate with the ML engineering side of the team on the interface between the API layer and the model serving stack, ensuring latency and reliability requirements are met end-to-end.
Contribute to developer experience — API design, documentation, integration cookbooks, playground and showcasing how best-in-class voice agents are built.
Lay the groundwork for multiple new products down the line.
Requirements
5+ years of experience building large-scale, real-time distributed systems and API services.
Deep expertise in real-time streaming infrastructure — WebSocket server architecture, Server-Sent Events, bidirectional streaming, connection multiplexing, and stateful protocol design.
Expert-level programming in TypeScript and Python; experience with Rust is a plus.
Strong distributed systems fundamentals: load balancing, autoscaling, rate limiting, and traffic shaping for latency-sensitive workloads.
Experience with Kubernetes — including custom autoscalers, resource management, and health checking for stateful services.
Strong product sense — you care about API ergonomics and think about what developers building voice apps actually need.
Comfort working on a small, early-stage team where you'll wear multiple hats and move fast.
Experience with audio or media protocols (WebRTC, g711, PCM encoding) is a strong plus.
Familiarity with ML model serving infrastructure and how inference engines work is a plus — you'll interface with the serving layer regularly.
Full-stack experience (React, Next.js) is a nice-to-have for contributing to developer-facing tooling.
Bachelor's or Master's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.
Compensation
US base salary range: $200,000 - $260,000 + equity + benefits.
Skills
TypeScriptPythonRustKubernetesWebsocketHttp StreamingWebrtcReactNext.jsDistributed Systems
Build and operate scalable cloud infrastructure platforms, abstractions, and enterprise deployments for Decagon's agentic AI systems. Requires 4+ years in infrastructure/DevOps, deep expertise in Kubernetes, Terraform, major cloud providers, networking, and production reliability (monitoring, on-call).
200k – 400k/yr
On-site7+ YOEDevOps / SRE
Senior Software Engineer, Observability
Together AISan Francisco, CA
Senior Software Engineer building scalable observability platforms (metrics, logs, traces) with Prometheus, Grafana, OpenTelemetry and related tools for Together AI's GPU cloud infrastructure. Requires strong distributed systems and infrastructure-as-code experience.
200k – 280k/yr
On-site5+ YOEDevOps / SRE
Software Engineer
BasetenSan Francisco, CA
Lead Software Engineer building real-time observability and root-cause analysis for Baseten's large-scale GPU fabrics and high-performance networks. Requires strong distributed systems and infrastructure experience to correlate telemetry from switches, NICs, GPUs, and inference services.
200k – 380k/yr
Hybrid7+ YOEDevOps / SRE
Senior Software Engineer, Accelerated Delivery
SnowflakeMenlo Park, CA
Build and evolve continuous deployment, progressive delivery, and AI-augmented release platforms for safe, large-scale multi-cloud rollouts on Kubernetes at Snowflake. Requires strong systems programming (Golang/Java/C++), Kubernetes, observability, and DevOps experience.
200k – 288k/yr
Hybrid5+ YOEDevOps / SRE
Senior Software Engineer - Snowpark Container Service
SnowflakeBellevue, WA +1
Senior engineer to design, build, and lead development of Snowpark Container Services, a Kubernetes-based container compute platform. Requires 7+ years building large-scale distributed systems and strong coding skills in Java, C++, or Go.