Skip to content
TavusTavusSan Francisco, CA

Multimodal AI Model Optimization Research Engineer

Research Engineer optimizing multimodal AI models (video, audio, language) for production using distillation, quantization, sparsification. Focus on latency, cost, quality tradeoffs for real-time generative avatar systems.

Salary not listed
Hybrid5+ YOEML Engineering

About the role

Mission

Take cutting-edge research models and make them fast, efficient, and production-ready using sparsification, distillation, and quantization. Own the optimization lifecycle for key models: define metrics, run experiments, and benchmark trade-offs across latency, cost, and quality. Partner closely with researchers and engineers to turn new ideas into deployable systems.

Requirements

  • Strong experience in deep learning using PyTorch
  • Hands-on experience with model optimization and compression, including knowledge distillation, pruning/sparsification, quantization, and mixed precision
  • Understanding of efficient architectures such as low-rank adapters
  • Strong understanding of inference performance and GPU/accelerator fundamentals
  • Strong Python coding skills and reliable research engineering practices
  • Experience working with large models and datasets in cloud environments
  • Ability to read ML papers, reproduce results, and adapt ideas
  • Clear communication and collaboration skills

Preferred

  • Optimization of diffusion models, video/audio generative models, or large language models
  • Experience with real-time or streaming systems (low-latency APIs, WebRTC, streaming TTS/video)
  • Familiarity with TensorRT, ONNX Runtime, TVM, Triton, or XLA
  • Experience writing custom Triton/CUDA kernels or low-level performance tuning
  • Experience with experiment tracking, benchmarking, and profiling at scale
  • Prior experience in research engineering or applied science roles

Skills

PyTorchModel OptimizationKnowledge DistillationPruningSparsificationQuantizationMixed PrecisionLow-Rank AdaptersGpu InferencePythonTensorRTOnnx RuntimeTvmTritonCUDA

Similar roles

ML Engineering jobs
Cerebras Systems

CoDesign & NextGen Performance Engineer

Cerebras SystemsSunnyvale, CA

Characterize, analyze, and optimize performance of state-of-the-art AI models on Cerebras' wafer-scale hardware. Build performance models, optimize kernels and compilers, debug runtime behavior, and develop visualization tools to influence next-gen AI architecture.

Salary not listed
On-site3+ YOEML Engineering
OpenAI

Research Engineer, Privacy

OpenAISan Francisco, CA

Research Engineer on OpenAI's Privacy team designing and prototyping privacy-preserving ML algorithms like differential privacy and federated learning at scale. Requires hands-on PETs experience, fluency in PyTorch/JAX, and a track record implementing or publishing novel privacy work.

380k – 445k/yr
HybridML Engineering
Console

Research Engineer

ConsoleSan Francisco, CA

Research Engineer building self-improving AI agent systems at Console. Develop eval/optimization loops, fine-tune specialist models, and improve agent reasoning over enterprise context using production data to drive measurable gains in quality, latency, and reliability.

200k – 350k/yr
On-siteML Engineering
Notion

Software Engineer, AI Platform

NotionSan Francisco, CA +1

Build and scale the shared AI platform foundations at Notion, enabling fast and safe shipping of AI products. Requires experience with LLM/ML platforms, strong ownership, and comfort across backend, infrastructure, and product code.

180k – 201k/yr
Hybrid5+ YOEML Engineering
Liftoff

Machine Learning Engineer

LiftoffCalifornia

Machine Learning Engineer building statistical models, optimization systems, and experiments for mobile ad tech economics on the Revenue Engine team. Requires PhD in CS/ML/Economics and industry experience applying ML or economics at scale.

215k – 275k/yr
RemoteML Engineering