# Research Engineer, Frontier Speculative Decoding

**Company:** [Together AI](https://hotfix.jobs/companies/together-ai)
**Location:** San Francisco, CA, New York, NY
**Role:** AI Research
**Salary:** $190k – $270k/yr
**Skills:** Python, PyTorch, Kubernetes, Slurm, LLMs, Generative Models, Fsdp, Deepspeed, Hyperparameter Tuning, Distributed Training
**Posted:** 2026-02-09

> Develops novel speculator algorithms and fine-tunes LLMs for production deployment, bridging research and customer needs with focus on data curation, hyperparameter tuning, and checkpoint evaluation. Requires Python, PyTorch, and experience with GPU clusters.

## Job Description

## Responsibilities

- Design and iterate on novel speculator algorithms, combining architectural innovations with curated data to push accuracy–efficiency tradeoffs.
- Be the critical link between raw data and production-ready models, directly impacting customer success.
- Work in a fast-paced, high-impact role at the cutting edge of generative AI.
- Collaborate with experts to solve real-world, high-performance challenges.
- Collaborate directly with customers and core inference/Applied ML research teams to integrate work into the production platform.
- Enjoy a culture of deep technical ownership to solve challenging problems.

## Requirements

- Genuine love for data curation and processing with meticulous attention to detail.
- Demonstrated ability to perform effective hyperparameter searches and understand tuning trade-offs.
- Experience working with and building on existing training codebases.
- Strong attention-to-detail in evaluating model checkpoints for quality, performance, and reliability.
- Experience with Python and PyTorch.
- Familiarity with SLURM and/or Kubernetes clusters and managing jobs in high-performance computing environments.
- Familiarity with modern LLMs and generative models.
- Basic understanding of distributed training frameworks (e.g., FSDP, DeepSpeed).
- Bachelor’s, Master’s degree, or Ph.D. in Computer Science, Computer Engineering, or related field, or equivalent practical experience.

## Compensation

US base salary range: $190,000 - $270,000 + equity + benefits. Compensation determined by location, level, role, experience, skills, and job-related knowledge.

## Similar roles

- [ML Scientist](https://hotfix.jobs/jobs/401a3fda-7a0b-4af9-aa9c-134e4ae4b19c) - Sesame - San Francisco, CA - $190k – $320k/yr
- [Research Scientist / Engineer - Controllability, Personalization & Productization](https://hotfix.jobs/jobs/a7c58746-1ac7-4d77-a869-df157aee7090) - Luma AI - Palo Alto, CA - $188k – $395k/yr
- [ML Scientist](https://hotfix.jobs/jobs/76fb2442-a622-4fbd-89d3-5c63620026a3) - Wispr Flow - San Francisco, CA - $185k – $280k/yr
- [Research Scientist, Frontier Risk Evaluations](https://hotfix.jobs/jobs/fff54c85-716a-40de-964d-74f8c276583e) - Scale AI - San Francisco, CA - $197k – $247k/yr
- [Research Scientist, Agent Robustness](https://hotfix.jobs/jobs/6ab91c5e-6084-4fcb-8280-cc605af029d2) - Scale AI - San Francisco, CA - $197k – $247k/yr

**Apply:** https://hotfix.jobs/jobs/476399d3-0e17-43f5-96a5-ce6b591c2b98
**Canonical:** https://hotfix.jobs/jobs/476399d3-0e17-43f5-96a5-ce6b591c2b98