Skip to content
DeepgramDeepgram

Research Staff, Voice AI Foundations

Pioneers Latent Space Models to solve core challenges in voice AI, developing neural audio codecs, generative speech models, and scalable multimodal systems. Requires strong expertise in statistical learning, foundation models, and bridging theory to efficient deployment.

About the job

The Opportunity

Voice is the most natural modality for human interaction with machines. Current sequence modeling paradigms cannot deliver voice AI capable of universal human interaction due to fundamental data problems in audio. New paradigms for audio AI are needed to overcome these challenges.

The Role

As a Member of the Research Staff, you will pioneer the development of Latent Space Models (LSMs) to solve data, scale, and cost challenges in voice AI. Focus areas include:

  • Build next-generation neural audio codecs for extreme low bit-rate compression and high fidelity reconstruction.
  • Pioneer steerable generative models for synthesizing diverse human speech from codec latents.
  • Develop embedding systems that factorize codec latent space into interpretable dimensions.
  • Leverage latent recombination to generate synthetic audio data at scale for multimodal speech-to-speech systems.
  • Design model architectures, training schemes, and inference algorithms optimized for hardware efficiency.

The Challenge

Seeking researchers who:

  • See unsolved problems as opportunities to pioneer new approaches.
  • Identify critical experiments quickly.
  • Scale proofs-of-concept 100x.
  • Use AI to automate and amplify impact.

It's Important to Us That You Have

  • Strong mathematical foundation in statistical learning theory, particularly self-supervised and multimodal learning.
  • Deep expertise in foundation model architectures and scaling across modalities.
  • Proven ability to bridge theory and practice.
  • Demonstrated ability to build data pipelines for massive datasets.
  • Track record of designing controlled experiments.
  • Experience optimizing models for deployment and hardware constraints.
  • History of open-source contributions or research publications in speech/language AI.

Benefits & Perks

  • Medical, dental, vision benefits.
  • Unlimited PTO, generous parental leave, flexible schedule.
  • 401(k) with company match.
  • Learning/education stipend, conference participation.

Skills

Neural Audio Codecs, Generative Models, Latent Space Models, Self-Supervised Learning, Multimodal Learning, Foundation Models, Data Pipelines, Model Optimization, Speech Ai, Hardware Acceleration

Upstart

Upstart

United States

Staff Machine Learning Model Risk Specialist
$140k+/yrRemote7+ YOEAI Research

Evaluates model and Generative AI risks across Upstart Bank’s model inventory, conducting risk assessments, monitoring reviews, quantitative analyses, and governance activities. Requires a quantitative master’s degree, 4+ years of relevant experience, and coding skills in Python, R, or similar languages.

Shield AI

Shield AI

Washington, DC
Senior Staff Engineer, Autonomy Capabilities – Maritime
$221k+/yrOn-site10+ YOEAI Research

Leads technical direction and develops maritime autonomy capabilities for unmanned surface and underwater vehicles, including motion planning, localization, safe behaviors, and heterogeneous multi-agent collaboration. Requires deep robotics and unmanned-systems experience, strong C++/Python skills, and senior technical leadership.

Shield AI

Shield AI

San Mateo, CA

Senior Staff Software Engineer, Autonomy Capabilities
$281k+/yrOn-site10+ YOEAI Research

Leads design, implementation, integration, and field validation of tactical autonomy software for unmanned systems and multi-agent missions. Requires extensive autonomy or robotics experience, strong C++ and Python skills, and the ability to obtain a SECRET clearance.

Anthropic

Anthropic

San Francisco, CA

Staff+ Researcher, Cybersecurity Products
$405k+/yrHybrid7+ YOEAI Research

Research and evaluate frontier AI capabilities for cybersecurity, rapidly prototyping tools, designing rigorous benchmarks, and helping operationalize reliable capabilities into products. Requires deep security expertise, strong technical communication, and at least seven years of relevant experience.

Order.co

Order.co

United States

Staff Applied AI Scientist
No salary listedRemote10+ YOEAI Research

Own the architecture, delivery, evaluation, and production operations of AI capabilities embedded in procurement and finance workflows. The role requires 10+ years in applied AI or machine learning, deep LLM and agent expertise, and experience delivering measurable production outcomes.