# Research Intern, Inference

**Company:** [Together AI](https://hotfix.jobs/companies/together-ai)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $121k – $131k/yr
**Experience:** 0+ years
**Skills:** PyTorch, JAX, Python, Machine Learning, Deep Learning, Transformer Architectures, CUDA, Ml Systems
**Posted:** 2026-06-12

> Research intern on the Inference team building efficient serving systems for large foundation models. Focus on distributed inference, compiler-aware optimization, and novel inference-time strategies.

## Job Description

## Responsibilities
- Design and conduct rigorous experiments to validate hypotheses
- Communicate the plans, progress, and results of projects to the broader team
- Document findings in scientific publications and blog posts

## Requirements
- Currently pursuing a final year of Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
- Strong knowledge of Machine Learning and Deep Learning fundamentals
- Experience with deep learning frameworks (PyTorch, JAX, etc.)
- Strong programming skills in Python
- Familiarity with Transformer architectures and recent developments in foundation models

## Preferred Qualifications
- Prior research experience in foundation models, efficient machine learning, or ML systems
- Publications at leading conferences in machine learning or systems (i.e., MLSys, ICLR)
- Experience with CUDA programming (for kernel development)
- Understanding of model optimization techniques and hardware acceleration approaches
- Contributions to open-source machine learning projects

## Internship Program Details
- Fall internship program spans 12 to 16 weeks
- Dates: September 14th to December 18th

## Similar roles

- [Research Intern, Model Shaping](https://hotfix.jobs/jobs/0e887d1e-0c73-467c-ab28-204b1ff9fbfe) - Together AI - San Francisco, CA - $121k – $131k/yr
- [Systems Research Engineer Intern - GPU Programming](https://hotfix.jobs/jobs/e8ab04b5-6d2f-4152-ad68-8143af8b6417) - Together AI - San Francisco, CA - $121k – $131k/yr
- [Quantitative Researcher](https://hotfix.jobs/jobs/4e070f2c-1ae6-4443-9347-82d26724abdc) - Trexquant - New York, NY - $120k – $180k/yr
- [Machine Learning Engineer](https://hotfix.jobs/jobs/04313290-8e0d-49b1-9c43-81cfbb0d9789) - Mariana Minerals - Ann Arbor, MI - $120k – $160k/yr
- [Founding AI Engineer](https://hotfix.jobs/jobs/09a63ffc-a750-417f-9010-aad2ebfde73f) - Bild AI - San Francisco, CA - $120k – $180k/yr

**Apply:** https://hotfix.jobs/jobs/6ec5d52e-f1b5-467f-8f4f-af9403ff93d8
**Canonical:** https://hotfix.jobs/jobs/6ec5d52e-f1b5-467f-8f4f-af9403ff93d8