Research Scientist / Engineer - Controllability, Personalization & Productization
Develops controllability, personalization, and productization for video foundation models using fine-tuning, RL, and evaluation techniques. Requires deep expertise in visual generative models, PyTorch, and product-focused research for creative workflows.
About the job
What You’ll Do
- Work as a fullstack researcher across modeling, data, systems, and evaluation to translate foundational capabilities into personalized and high-fidelity tools for creative production.
- Controllability and Features: Use SFT, RL, distillation, and adapter-based methods to give models precise control and creative capabilities for high-fidelity workflows.
- Personalization: Use context management, PEFT, and preference learning to embed domain expertise and long-horizon memory; ground data engine in real-world workflows.
- End-User Quality: Define success metrics, build user-aligned evaluations, and iterate on model/data/evals loop for fidelity and reliability in specific verticals.
- Cross-functional Collaboration: Partner with Product and Design to turn creative intent and user feedback into specs and shippable model behaviors.
Who You Are
- Strong foundation in machine learning with deep experience in visual generative models (diffusion/transformers or related architectures).
- Deep understanding of at least one: fine-tuning, personalization, domain adaptation, data curation, targeted distillation, interpretability, or human-feedback-driven refinement.
- Product-obsessed researcher/engineer focused on end users and partners.
- Hands-on experience with PyTorch and large model training.
Bonus Points
- Contributions to state-of-the-art models in image/video generation.
- Experience collaborating with creative partners (VFX, animation, film, design tools).
- Track record building workflows/tools that improve iteration speed and evaluation rigor.
- Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).
Compensation
Base pay range: $187,500 – $395,000 per year.
Skills
PyTorch, Diffusion Models, Transformers, Sft, Rl, Peft, Distillation, Adapters, Ray, Kubernetes
Similar jobs
AI Research jobs
Earnin
Mountain View, CA
Build agent-driven chatbots and generative AI workflows for financial-wellness products, owning features from design through impact measurement. The role requires at least three years of software engineering experience, strong system design, maintainable coding practices, and a bachelor’s degree or equivalent experience.
Scale AI
San Francisco, CAResearch Scientist focused on evaluating frontier language and multimodal models, diagnosing failure modes, and building rigorous benchmarks. The role requires advanced training in AI or a related field, post-training expertise, and published machine learning research.
Scale AI
San Francisco, CAResearch novel post-training methods for large language models, focusing on preference optimization, data curation, evaluation, alignment, and robustness across text and multimodal systems. Requires advanced academic training and experience with deep learning, reinforcement learning, and post-training techniques.
Hightouch
United States
Develops experimental AI techniques and prototypes for agentic marketing applications, with emphasis on image and video generation. The role requires strong backend or probabilistic systems expertise, quantitative thinking, creativity with LLM applications, and product intuition.
Greptile
San Francisco, CA
The Research Engineer will apply advances in agents and language models to build and evaluate multi-agent systems for automated code validation and review. The role requires a computer science or equivalent background, research experience, strong programming skills, and product intuition.