Applied Research Scientist / Engineer
Work as a fullstack applied researcher adapting multimodal video foundation models for production. Focus on controllability, personalization, and end-user quality using SFT, RL, and data-driven refinement.
About the job
What You'll Do
You will work as a fullstack applied researcher across modeling, data, systems, and evaluation to adapt and deploy models to production.
Controllability and Features
- Leverage a toolkit spanning SFT, RL, personalization, distillation, control adapters, and more, to develop and maintain model variants purpose-built for user environments and creative partners.
Personalization
- Architect the data engine for rapid adaptation.
- Leverage proprietary, vertical-specific datasets to create specialized finetunes and improve future training recipes, ensuring our models rely on data that reflects real-world use cases.
End-User Quality
- Define and drive end-user quality – setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet strict fidelity and reliability targets in specific enterprise verticals.
Cross-functional Collaboration
- Partner closely with Product, Research, and Design to translate creative intent and user feedback into model behavior, intuitive controls, and production-ready capabilities for users and partners.
Who You Are
- Product-Obsessed Researcher/Engineer: Treat end users and partners as collaborators and enjoy solving specific “last mile” problems—not just optimizing public metrics.
- ML Expert: Strong ML fundamentals with deep experience in visual generative models (diffusion/transformers or related architectures). Ideal candidates also have a deep understanding of at least one: fine-tuning, personalization, domain adaptation, data curation, targeted distillation, interpretability, or human-feedback-driven refinement.
- Hands-On Builder: Strong Python and deep learning engineering skills (ideally PyTorch), comfortable moving between research prototypes and production systems.
Bonus Points
- Contributions to state-of-the-art models in image/video generation.
- Experience collaborating with creative partners (VFX, animation, film, design tools).
- Track record building workflows/tools that materially improve iteration speed and evaluation rigor.
- Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).
Compensation
The base pay range for this role is $200,000 – $450,000 per year.
Skills
Python, PyTorch, Diffusion Models, Transformers, Fine-Tuning, Personalization, Domain Adaptation, Data Curation, Distillation, Sft, Rl, Interpretability, Human Feedback
Similar jobs
AI Research jobsResearch and build safety models, evaluations, and runtime safeguards for conversational AI agents, addressing prompt injection, unsafe tool use, privacy, and policy risks. Requires 4+ years in AI/ML engineering, research, or safety plus experience deploying and evaluating language models or agentic systems.
Build and expand customer-facing agentic AI products, MCP integrations, and automated reconciliation workflows for private fund management. The role requires senior-level software engineering, strong systems thinking, product judgment, and hands-on experience building and evaluating AI systems.
Build Vanta’s organizational intelligence layer by shipping prototypes, internal tools, and AI agent workflows that make cross-source data useful to EPD, GTM, and other teams. The role requires recent hands-on LLM product work, independent problem scoping, and strong judgment around AI quality, reliability, cost, and latency.
Conduct research and build open foundation models and training systems aimed at accelerating scientific discovery. The role requires a PhD-level background and substantial experience training foundation models, with expertise in agentic training or multimodal data preferred.
Own applied multimodal ML research from clinical problem definition through production, developing and rigorously evaluating computer vision, NLP, and deep learning systems for radiology. Requires strong Python and PyTorch expertise, 4+ years of relevant experience, and an MS, PhD, or equivalent practical experience.