# Tech Lead Manager- MLRE, ML Systems

**Company:** [Scale AI](https://hotfix.jobs/companies/scale-ai)
**Location:** San Francisco, CA, New York, NY, Seattle, WA
**Role:** ML Engineering
**Salary:** $252k – $315k/yr
**Skills:** PyTorch, CUDA, Transformers, Flash Attention, RLHF, Ppo, Distributed Ml Systems, Llm Training, Llm Inference, Kubernetes
**Posted:** 2026-02-12

> Leads development and optimization of distributed frameworks for LLM post-training, training, and inference. Collaborates with ML teams to enable advanced model development and data curation, requiring expertise in large-scale ML systems and tools like PyTorch and CUDA.

## Job Description

## You will:
- Build, profile and optimize our training and inference framework.
- Collaborate with ML and research teams to accelerate their research and development, and enable them to develop the next generation of models and data curation.
- Research and integrate state-of-the-art technologies to optimize our ML system.

## Ideally you’d have:
- Passionate about system optimization
- Experience with multi-node LLM training and inference
- Experience with developing large-scale distributed ML systems
- Experience with post-training methods like RLHF/RLVR and related algorithms like PPO/GRPO etc.
- Strong software engineering skills, proficient in frameworks and tools such as **CUDA**, **PyTorch**, **transformers**, **flash attention**, etc.
- Strong written and verbal communication skills to operate in a cross functional team environment.

## Nice to haves:
- Demonstrated expertise in post-training methods and/or next generation use cases for large language models including instruction tuning, **RLHF**, tool use, reasoning, agents, and multimodal, etc.

## Similar roles

- [MTS, Research Engineer](https://hotfix.jobs/jobs/0273a0e6-dc4b-4119-9fdd-3dd7f803507f) - Fireworks AI - New York, NY - $250k – $400k/yr
- [Senior Software Engineer, Agents](https://hotfix.jobs/jobs/4a99517c-fdfa-45f1-b418-1c56c0283bc5) - Decagon - New York, NY - $250k – $330k/yr
- [Senior Software Engineer, Agents](https://hotfix.jobs/jobs/08c9a7f1-7f6b-4833-a712-749af71fd566) - Decagon - San Francisco, CA - $250k – $330k/yr
- [Lead AI Engineer](https://hotfix.jobs/jobs/9d0c2929-9419-4de9-854b-fd4d725dbe47) - Sphere - San Francisco, CA - $250k – $280k/yr
- [Senior Machine Learning Operations Engineer](https://hotfix.jobs/jobs/09dfbfbe-1163-4729-acd6-bb23621bd7ac) - Garner Health - New York City, NY - $256k – $285k/yr

**Apply:** https://hotfix.jobs/jobs/f661f258-9c11-4ef0-b917-831800c6571d
**Canonical:** https://hotfix.jobs/jobs/f661f258-9c11-4ef0-b917-831800c6571d