Skip to content
Retell AIRetell AIRedwood City, CA

Research Scientist - Audio

Conducts ML research on LLMs and audio models to enhance real-time voice agents' reasoning, latency, and conversational quality. Prototypes models, designs evaluations, and bridges research to production systems requiring strong PyTorch expertise and experimental mindset.

225k – 400k/yr
On-siteML Engineering

About the role

Key Responsibilities

  • Research & Experimentation – Explore and develop new techniques across LLMs and audio models to improve reasoning, latency, and conversational quality in real-time systems.
  • Model Prototyping – Rapidly build and iterate on experimental models and pipelines, turning research ideas into working prototypes.
  • Evaluation & Benchmarking – Design novel evaluation frameworks, datasets, and metrics to measure performance on complex, real-world voice tasks.
  • Bridge Research to Production – Collaborate closely with engineering to translate research insights into deployable systems.
  • Human Feedback Loops – Develop methods to incorporate human evaluation into model improvement, especially for subjective conversational quality.
  • Advance the Frontier – Stay at the cutting edge of ML research and bring new ideas into Retell’s product and infrastructure.

Requirements

  • Strong ML Research Background – Worked on advanced ML problems (e.g., LLM pre-training and post training, transcription model training, text to speech model training, or multimodal systems), either in industry or academia.
  • Deep Technical Foundation – Comfortable with PyTorch, model architectures, and the math behind modern machine learning.
  • Experimental Mindset – Enjoy exploring open-ended problems and iterating quickly on ideas.
  • Bridging Theory & Practice – Translate research into systems that work in real-world environments.
  • Startup-Ready – Thrive in fast-paced environments with high ownership and ambiguity.
  • Collaborative & Clear Communicator – Explain complex ideas and work cross-functionally to drive impact.

Compensation

Cash: $225,000 - $400,000 base salary
Equity: Offers Equity
Other Benefits: 100% coverage for medical, dental, and vision insurance; $70/day DoorDash credit; $200/month wellness reimbursement; $300/month commuter reimbursement; $75/month phone bill reimbursement; $50/month internet reimbursement

Skills

PyTorchLLMsAudio ModelsMachine LearningText-To-SpeechTranscriptionMultimodal SystemsModel Architectures

Similar roles

ML Engineering jobs
Latent

Research Scientist

LatentSan Francisco, CA

Owns end-to-end ML research initiatives developing novel architectures, training methods, and evaluation for clinical intelligence using longitudinal patient data. Requires strong ML foundation, PyTorch experience, and ability to drive ambiguous high-stakes problems to validated results.

225k – 300k/yr
On-siteML Engineering
Latent

Machine Learning Engineer

LatentSan Francisco, CA

Owns end-to-end production ML systems for clinical workflows, including training/fine-tuning LLMs for medical reasoning and question answering. Requires strong ML/software engineering, PyTorch experience, and ability to handle high-stakes ambiguity with real patient impact.

225k – 300k/yr
On-siteML Engineering
character.ai

Research Engineer, Multimodal

character.aiRedwood City, CA

Research Engineer advancing video/image generation models for AI characters, leading fine-tuning, novel architectures, data pipelines, and optimizations using PyTorch and multimodal techniques. Requires expertise in generation models and distributed training.

225k – 400k/yr
On-siteML Engineering
character.ai

Research Engineer, Post-Training (All Industry Levels)

character.aiUnited States

Develops alignment algorithms, data pipelines, and sampling methods to optimize post-training AI models for performance and efficiency. Requires PhD or equivalent, ML expertise including reinforcement learning and transformers, and production code experience.

225k – 400k/yr
RemoteML Engineering
Abridge

Machine Learning Infrastructure Engineer- Model Inference

AbridgeSan Francisco, CA

Builds and optimizes scalable ML inference infrastructure using Kubernetes and GPU resources to deploy production AI models with low latency. Collaborates with ML research and product teams on model serving, orchestration, and compute efficiency.

221k – 260k/yr
HybridML Engineering