# Research Scientist / Engineer — Multimodal Agent

**Company:** [Luma AI](https://hotfix.jobs/companies/lumalabs-ai)
**Location:** Palo Alto, CA
**Role:** ML Engineering
**Salary:** $250k – $450k/yr
**Skills:** PyTorch, Machine Learning, Foundation Models, LLMs, Vlm, Distributed Training, Mixed Precision Training, Multimodal Models, Agentic Systems, Reasoning Models, Coding Models, Tool Calling, Data Pipelines, Gpu Clusters
**Posted:** 2026-03-31

> Builds and trains large-scale multimodal agentic models involving reasoning, planning, coding, and tool calling. Requires strong ML foundations, PyTorch expertise, and experience with distributed training on massive datasets.

## Job Description

## What You'll Do

### Modeling
- Architect large-scale multimodal agentic models that use reasoning, planning, coding, and tool calling to achieve complex, multi-step multimodal work.

### Data
- Hillclimbing existing tasks and formulating new tasks through data.
- Design, implement, and run robust data pipelines for constructing, enriching, and filtering massive pixel datasets.

### Systems
- Train large-scale multimodal models on massive datasets and GPU clusters.

### Evaluation
- Define and build novel evaluation frameworks to measure multimodal agents.

## Who You Are
- Strong foundation in machine learning, foundation models and agentic systems.
- Deep understanding of agentic systems and approaches in LLM/VLM reasoning, coding models, LLM/VLM tool calling.
- Hands-on experience with PyTorch and large-scale training (distributed, mixed precision, large datasets).

## What Sets You Apart (Bonus Points)
- Experience in the following around data, modeling, or evaluation: State-of-the-art foundation models in reasoning, State-of-the-art foundation models in coding, State-of-the-art foundation models in tool calling, State-of-the-art multimodal agents.

## Compensation
- The base pay range for this role is $250,000 – $450,000 per year.

## Similar roles

- [Researcher, Alignment Oversight](https://hotfix.jobs/jobs/38516bf4-430f-4588-bcd3-f148cc262645) - OpenAI - San Francisco, CA - $250k – $445k/yr
- [Research Engineer, Evals](https://hotfix.jobs/jobs/b26f895d-8d3e-45a8-8acd-55835c2721d3) - Variance - San Francisco, CA - $250k – $400k/yr
- [Research Engineer, Judgment Systems](https://hotfix.jobs/jobs/d22f5c9e-5811-409f-8801-81a01c43869a) - Variance - San Francisco, CA - $250k – $400k/yr
- [AI Engineer](https://hotfix.jobs/jobs/403d3c36-7dd3-4196-a511-2cd4e5a89b09) - Moment - New York, NY - $250k – $325k/yr
- [AI Inference Engineer - Model Optimization & Deployment](https://hotfix.jobs/jobs/98f84382-a376-49eb-ab15-fc95bdd56e3f) - Zoox - Foster City, CA - $242k – $290k/yr

**Apply:** https://hotfix.jobs/jobs/c336622c-2837-473e-b233-d1aae1a465c3
**Canonical:** https://hotfix.jobs/jobs/c336622c-2837-473e-b233-d1aae1a465c3