# MTS, Research Engineer

**Company:** [Fireworks AI](https://hotfix.jobs/companies/fireworks-ai)
**Location:** New York, NY, San Mateo, CA
**Role:** ML Engineering
**Salary:** $250k – $400k/yr
**Experience:** 7+ years
**Skills:** Python, C++, Rust, PyTorch, JAX, TensorFlow, CUDA, Nccl, Mpi, Linear Algebra, Triton, Sglang, vLLM
**Posted:** 2026-07-08

> Research Engineer conducting open-ended ML research, reproducing SOTA papers, building/scaling distributed training infrastructure on GPU clusters, and bridging research ideas into production code. Requires strong programming, ML frameworks, distributed systems experience, and math foundations; Master's/PhD preferred.

## Job Description

## What You'll Do
- Conduct Open-Ended Research: Explore new model architectures, training objectives, and optimization techniques. Formulate hypotheses, design experiments, and iterate quickly based on empirical results.
- Reproduce and Extend State-of-the-Art: Implement and reproduce results from recent machine learning papers. Identify bottlenecks, propose improvements, and scale these methods to larger datasets and models.
- Build and Scale Training Infrastructure: Design, implement, and maintain high-performance, distributed machine learning systems. Optimize training loops, data loaders, and communication overhead across large GPU clusters.
- Bridge Science and Engineering: Translate abstract mathematical concepts and research ideas into robust, bug-free, and efficient code.
- Collaborate Cross-Functionally: Work closely with Research Scientists to unblock their experiments by providing tooling, optimizing code, and co-designing experiments that are hardware-aware.

## Requirements
- Strong programming skills (Python, C++, or Rust) and a commitment to writing clean, maintainable code.
- Deep practical knowledge of machine learning frameworks (PyTorch, JAX, or TensorFlow).
- Experience working with large distributed systems and parallel computing (e.g., CUDA, NCCL, MPI).
- A strong foundation in linear algebra, calculus, probability, and statistics.
- A proven track record of implementing complex deep learning algorithms from scratch.

## Nice to Have
- A Master’s or PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related field (or equivalent industry experience).
- Experience with low-level GPU programming (CUDA/Triton) or hardware co-design.
- Familiarity with the challenges of training Large Language Models (LLMs).
- Familiarity with the challenges of inference, and OSS inference engines such as SGLang and vLLM.

## Similar roles

- [Senior Software Engineer, Agents](https://hotfix.jobs/jobs/4a99517c-fdfa-45f1-b418-1c56c0283bc5) - Decagon - New York, NY - $250k – $330k/yr
- [Senior Software Engineer, Agents](https://hotfix.jobs/jobs/08c9a7f1-7f6b-4833-a712-749af71fd566) - Decagon - San Francisco, CA - $250k – $330k/yr
- [Lead AI Engineer](https://hotfix.jobs/jobs/9d0c2929-9419-4de9-854b-fd4d725dbe47) - Sphere - San Francisco, CA - $250k – $280k/yr
- [Tech Lead Manager- MLRE, ML Systems](https://hotfix.jobs/jobs/f661f258-9c11-4ef0-b917-831800c6571d) - Scale AI - San Francisco, CA - $252k – $315k/yr
- [Senior Machine Learning Operations Engineer](https://hotfix.jobs/jobs/09dfbfbe-1163-4729-acd6-bb23621bd7ac) - Garner Health - New York City, NY - $256k – $285k/yr

**Apply:** https://hotfix.jobs/jobs/0273a0e6-dc4b-4119-9fdd-3dd7f803507f
**Canonical:** https://hotfix.jobs/jobs/0273a0e6-dc4b-4119-9fdd-3dd7f803507f