Senior AI Engineer, Voice Platform
Own and evolve AI systems for ClickUp's voice platform including real-time transcription, LLM post-processing, and voice-to-action pipelines.
About the job
Key Responsibilities
- Design, build, and optimize real-time speech-to-text pipelines (streaming ASR, VAD, audio processing)
- Improve transcription accuracy through context injection (user names, teams, custom vocabulary, language detection)
- Develop and maintain LLM-powered post-processing (grammar correction, filler removal, mention resolution, formatting)
- Build voice-to-action systems that parse natural language into structured workspace commands
- Evaluate, benchmark, and integrate ASR models (Whisper, AssemblyAI, Fireworks, etc.) for cost, latency, and accuracy
- Collaborate with product and platform teams to ship voice features across MAX Desktop, Mobile, Web, and Browser Extension
- Explore multimodal AI capabilities (screen + voice + text) for next-gen assistant experiences
Requirements
- Deep experience with real-time speech-to-text pipelines and streaming ASR systems
- Proficiency with audio processing, VAD, and voice activity detection
- Strong background in LLM-powered post-processing for transcription (grammar correction, formatting, entity resolution)
- Experience evaluating and integrating ASR models such as Whisper, AssemblyAI, or similar
- Ability to build voice-to-action / natural language command parsing systems
- Experience shipping features across desktop, mobile, and web platforms
- Interest in multimodal AI (combining screen, voice, and text inputs)
Skills
Asr, Whisper, LLMs, Real-Time Streaming, Speech-To-Text, Vad, Audio Processing, Voice-To-Action, Multimodal Ai, Assemblyai
Similar jobs
ML Engineering jobs
Traba
New York, NYBuild and deploy production AI-agent systems, including their harnesses, evaluations, orchestration, and supporting services. The role requires 5+ years of software engineering experience, production LLM or agent experience, and strong Python or TypeScript/Node.js skills.
Metriport
San Francisco, CA
Own machine learning end to end, from modeling messy clinical data through production deployment, monitoring, and infrastructure. The role requires 7+ years of experience building scalable ML systems, strong software and data engineering skills, and proficiency with Python, SQL, and cloud platforms.
SentiLink
United States
Leads and manages an applied machine learning team developing production fraud detection and identity verification models. The role combines people leadership with hands-on technical work and requires substantial ML experience, production deployment expertise, and experience in risk-focused domains.
Airbnb
United States
Builds and productionizes machine learning systems for trust and safety, including abuse detection, autonomous AI agents, and evaluation frameworks. The role requires 5+ years of applied ML experience, strong Python skills, experience with LLMs and scalable pipelines, and a relevant advanced degree or equivalent background.
6sense
San Francisco, CA
Owns end-to-end production machine learning systems, including NLP, LLM, agentic, ranking, and recommendation capabilities. Requires 8+ years of industry experience, strong Python and cloud ML expertise, and the ability to deliver explainable AI products with cross-functional and customer impact.