Skip to content
Luma AILuma AIPalo Alto, CA

Research Scientist / Engineer - Controllability, Personalization & Productization

Develops controllability, personalization, and productization for video foundation models using fine-tuning, RL, and evaluation techniques. Requires deep expertise in visual generative models, PyTorch, and product-focused research for creative workflows.

188k – 395k
HybridAI Research

About the role

What You’ll Do

  • Work as a fullstack researcher across modeling, data, systems, and evaluation to translate foundational capabilities into personalized and high-fidelity tools for creative production.
  • Controllability and Features: Use SFT, RL, distillation, and adapter-based methods to give models precise control and creative capabilities for high-fidelity workflows.
  • Personalization: Use context management, PEFT, and preference learning to embed domain expertise and long-horizon memory; ground data engine in real-world workflows.
  • End-User Quality: Define success metrics, build user-aligned evaluations, and iterate on model/data/evals loop for fidelity and reliability in specific verticals.
  • Cross-functional Collaboration: Partner with Product and Design to turn creative intent and user feedback into specs and shippable model behaviors.

Who You Are

  • Strong foundation in machine learning with deep experience in visual generative models (diffusion/transformers or related architectures).
  • Deep understanding of at least one: fine-tuning, personalization, domain adaptation, data curation, targeted distillation, interpretability, or human-feedback-driven refinement.
  • Product-obsessed researcher/engineer focused on end users and partners.
  • Hands-on experience with PyTorch and large model training.

Bonus Points

  • Contributions to state-of-the-art models in image/video generation.
  • Experience collaborating with creative partners (VFX, animation, film, design tools).
  • Track record building workflows/tools that improve iteration speed and evaluation rigor.
  • Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).

Compensation

Base pay range: $187,500 – $395,000 per year.

Skills

PyTorchDiffusion ModelsTransformersSftRlPeftDistillationAdaptersRayKubernetes

Similar roles

AI Research jobs
Sesame

ML Scientist

SesameSan Francisco, CA +2

Research-oriented Machine Learning Scientist developing multimodal ML models (NLP, Speech, Computer Vision) for lifelike voice agents. Requires published papers in large-scale deep learning and familiarity with SOTA AI.

190k – 320k
On-siteAI Research
Together AI

Research Engineer, Frontier Speculative Decoding

Together AISan Francisco, CA +1

Develops novel speculator algorithms and fine-tunes LLMs for production deployment, bridging research and customer needs with focus on data curation, hyperparameter tuning, and checkpoint evaluation. Requires Python, PyTorch, and experience with GPU clusters.

190k – 270k
On-siteAI Research
Wispr Flow

ML Scientist

Wispr FlowSan Francisco, CA

Develops scalable voice interface features through prototyping, infrastructure building, and R&D. Requires PhD in ML or related field, top conference publications, Python/LLM fluency, and strong engineering skills.

185k – 280k
On-siteAI Research
Datology AI

Research Engineer

Datology AIRedwood City, CA

As a Research Engineer, you will conduct and enable cutting-edge research, translating it into the core product pipeline. You will develop and improve state-of-the-art data curation strategies, accelerating research and ensuring product innovation.

180k – 300k
On-site4+ YOEAI Research
AE Studio

Alignment Scientist/Engineer

AE StudioLos Angeles, CA

Join the alignment research team to work on high-impact, under-resourced projects focused on AI alignment. This role requires strong ML research and Python skills to build, train, or evaluate deep learning models.

180k – 240k
RemoteAI Research