Skip to content
TavusTavusSan Francisco, CA

Conversational Modelling Research Engineer

AI Researcher develops and fine-tunes large multimodal models for real-time conversational avatars, modeling verbal/non-verbal behaviors with low latency. Requires PhD or equivalent, hands-on experience with VLMs, PyTorch, and deep learning.

Salary not listed
RemoteAI Research

About the role

Responsibilities

  • Conduct research on Large Multimodal Models in the context of Conversational Avatars (e.g. Neural Avatars, Talking-Heads).
  • Develop methods to model both verbal and non-verbal aspects of conversation, adapting and controlling avatar behavior in real time, with low-latency.
  • Experiment with fine-tuning, adaptation, and conditioning techniques to make AudioVisual Multimodal Models more expressive, controllable, and task-specific.
  • Partner with the Applied ML team to take research from prototype to production.
  • Stay up to date with cutting-edge advancements.

Requirements

  • PhD (or near completion) in a relevant field, or equivalent research experience.
  • Hands-on experience with Large Multimodal Models and a strong foundation in generative (language) models (e.g. VQA, Audio/Video understanding, captioning, behavioral analysis, Translation, Speech to Speech systems).
  • Experience in fine-tuning/adapting VLMs for control, conditioning, or downstream tasks.
  • Solid background in deep learning and foundation models.
  • Strong PyTorch skills and comfort building deep learning pipelines.

Nice-to-Haves

  • Knowledge of large-scale model training and optimization.
  • Experience in duplex-conversational models.
  • Broader understanding of generative AI across modalities.
  • Exposure to software development best practices.
  • Flexible, experimental mindset (working across research and engineering).
  • (Bonus) Publications at EMNLP, COLING, NeurIPS, ICLR, CVPR, ICCV.

Skills

PyTorchLarge Multimodal ModelsVision Language ModelsGenerative ModelsDeep LearningFine-TuningAudio/Video UnderstandingVqaSpeech To SpeechNeural Avatars

Similar roles

AI Research jobs
Sesame

ML Scientist

SesameSan Francisco, CA +2

Research-oriented Machine Learning Scientist developing multimodal ML models (NLP, Speech, Computer Vision) for lifelike voice agents. Requires published papers in large-scale deep learning and familiarity with SOTA AI.

190k – 320k
On-siteAI Research
OpenRouter

Research Scientist

OpenRouterUnited States

Conduct original research on LLM evaluation, routing optimization, and model behavior using billions of real-world generations. Design novel benchmarks, run large-scale empirical studies, and develop statistical foundations for intelligent routing. Requires MS/PhD, publication track record, deep stats/ML expertise, and Python/SQL skills.

Salary not listed
RemoteAI Research
hud

Research Engineer, Benchmarks

hudSan Francisco, CA

Build high-quality, domain-specific benchmarks and infrastructure to rigorously evaluate frontier AI agents on realistic workflows. Requires strong Python/Docker/Linux skills, experience with evals or benchmarks, and a deep understanding of what makes a benchmark reliable and useful.

Salary not listed
On-siteAI Research
Spotify

Research Scientist

SpotifyNew York, NY

Research Scientist advancing generative audio models (diffusion/flow matching) for music, focusing on vocal synthesis, post-training alignment (DPO/RLHF), or audio editing. Requires PhD, top publications, and PyTorch expertise to turn research into artist-first Spotify products.

Salary not listed
RemoteAI Research
Anthropic

Research Scientist, Life Sciences

AnthropicSan Francisco, CA

Founding Research Scientist on Anthropic's Life Sciences team, designing and executing wet-lab experiments in molecular biology and biochemistry. Partners with computational biologists and uses Claude AI for hypothesis generation, experimental planning, and rapid iteration to drive AI-accelerated biological discoveries.

300k – 320k
HybridAI Research