# TPU Kernel Engineer

**Company:** [Anthropic](https://hotfix.jobs/companies/anthropic)
**Location:** San Francisco, CA, New York, NY, Seattle, WA
**Role:** ML Engineering
**Salary:** $280k – $850k/yr
**Skills:** Tpu, GPU, Kernel Optimization, Ml Systems, Computer Architecture, Ml Frameworks, Transformers, Collective Communication, Low-Precision Inference, Assembly
**Posted:** 2026-02-12

> Designs and optimizes TPU kernels to address performance issues in ML research, training, and inference systems. Provides feedback on model impacts and solves large-scale systems problems, requiring deep accelerator expertise.

## Job Description

## You may be a good fit if you:
- Have significant experience optimizing ML systems for TPUs, GPUs, or other accelerators
- Are results-oriented, with a bias towards flexibility and impact
- Pick up slack, even if it goes outside your job description
- Enjoy pair programming (we love to pair!)
- Want to learn more about machine learning research
- Care about the societal impacts of your work

## Strong candidates may also have experience with:
- High performance, large-scale ML systems
- Designing and implementing kernels for TPUs or other ML accelerators
- Understanding accelerators at a deep level, e.g. a background in computer architecture
- ML framework internals
- Language modeling with transformers

## Representative projects:
- Implement low-latency, high-throughput sampling for large language models
- Adapt existing models for low-precision inference
- Build quantitative models of system performance
- Design and implement custom collective communication algorithms
- Debug kernel performance at the assembly level

## Logistics
**Education requirements:** We require at least a Bachelor's degree in a related field or equivalent experience.

**Location-based hybrid policy:** Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

**Annual Salary:** $280,000 — $850,000 USD

## Similar roles

- [Manager, RL Algorithms & Decoder](https://hotfix.jobs/jobs/df151034-e50b-4d66-878f-a30545a55572) - Zoox - Foster City, CA - $277k – $349k/yr
- [Software Engineer, Workload Enablement](https://hotfix.jobs/jobs/c4fa7032-a3f8-424e-96b9-93f5b749c237) - OpenAI - San Francisco, CA - $293k – $455k/yr
- [Research Engineer, Retrieval & Search, Applied Engineering](https://hotfix.jobs/jobs/16d93174-4349-4f36-82d4-a5b06b69b2f5) - OpenAI - San Francisco, CA - $293k – $585k/yr
- [Distributed Training Engineer, Sora](https://hotfix.jobs/jobs/fe5c7041-cc15-401a-8921-5e929f6adf4d) - OpenAI - San Francisco, CA - $293k – $490k/yr
- [Machine Learning Engineer, Integrity](https://hotfix.jobs/jobs/9cf4e881-534a-4cbf-84a8-a17bac3e6692) - OpenAI - San Francisco, CA - $266k – $555k/yr

**Apply:** https://hotfix.jobs/jobs/2fa5364f-5193-4dd1-a2f0-ac815f3f6bcd
**Canonical:** https://hotfix.jobs/jobs/2fa5364f-5193-4dd1-a2f0-ac815f3f6bcd