Skip to content
DeepgramDeepgramCalifornia

Research Staff, Voice AI Foundations

Pioneers Latent Space Models to solve core challenges in voice AI, developing neural audio codecs, generative speech models, and scalable multimodal systems. Requires strong expertise in statistical learning, foundation models, and bridging theory to efficient deployment.

150k – 250k
RemoteAI Research

About the role

The Opportunity

Voice is the most natural modality for human interaction with machines. Current sequence modeling paradigms cannot deliver voice AI capable of universal human interaction due to fundamental data problems in audio. New paradigms for audio AI are needed to overcome these challenges.

The Role

As a Member of the Research Staff, you will pioneer the development of Latent Space Models (LSMs) to solve data, scale, and cost challenges in voice AI. Focus areas include:

  • Build next-generation neural audio codecs for extreme low bit-rate compression and high fidelity reconstruction.
  • Pioneer steerable generative models for synthesizing diverse human speech from codec latents.
  • Develop embedding systems that factorize codec latent space into interpretable dimensions.
  • Leverage latent recombination to generate synthetic audio data at scale for multimodal speech-to-speech systems.
  • Design model architectures, training schemes, and inference algorithms optimized for hardware efficiency.

The Challenge

Seeking researchers who:

  • See unsolved problems as opportunities to pioneer new approaches.
  • Identify critical experiments quickly.
  • Scale proofs-of-concept 100x.
  • Use AI to automate and amplify impact.

It's Important to Us That You Have

  • Strong mathematical foundation in statistical learning theory, particularly self-supervised and multimodal learning.
  • Deep expertise in foundation model architectures and scaling across modalities.
  • Proven ability to bridge theory and practice.
  • Demonstrated ability to build data pipelines for massive datasets.
  • Track record of designing controlled experiments.
  • Experience optimizing models for deployment and hardware constraints.
  • History of open-source contributions or research publications in speech/language AI.

Benefits & Perks

  • Medical, dental, vision benefits.
  • Unlimited PTO, generous parental leave, flexible schedule.
  • 401(k) with company match.
  • Learning/education stipend, conference participation.

Skills

Neural Audio CodecsGenerative ModelsLatent Space ModelsSelf-Supervised LearningMultimodal LearningFoundation ModelsData PipelinesModel OptimizationSpeech AiHardware Acceleration

Similar roles

AI Research jobs
Modal

Member of Technical Staff

ModalNew York, NY +1

Conduct hands-on post-training research on LLMs including RL, distillation, and routing models. Collaborate with customers, labs, and engineering to turn techniques into production products and shape the research agenda. Requires proven research background in post-training LLMs and ability to ship impactful work.

150k – 350k
On-siteAI Research
Deepgram

Research Staff, LLMs

DeepgramCalifornia

Conduct cutting-edge research on Large Language Models, focusing on transformer optimization, distributed training, data curation, and RL. Collaborate on experiments, deploy models to production, and drive voice AI innovations.

150k – 250k
RemoteAI Research
MongoDB

Staff Research Scientist

MongoDBPalo Alto, CA

Conduct frontier AI research on LLMs, embedding models, and rerankers for RAG and semantic search. Requires PhD in CS or related field plus strong publication record in top ML venues.

151k – 297k
HybridAI Research
Fireworks AI

Member of Technical Staff, Research

Fireworks AISan Mateo, CA

Conducts advanced research in AI, machine learning, or related fields, developing novel algorithms and publishing results. Requires PhD and strong publication record.

175k – 240k
On-siteAI Research
Machinify

Staff NLP Scientist

MachinifyUnited States

Develops state-of-the-art VQA systems for medical records using advanced NLP and CV techniques to achieve expert-level accuracy in document analysis. Requires deep expertise in NLP/CV, strong software engineering, and ability to work with noisy data in healthcare domain.

180k – 280k
RemoteAI Research