Skip to content
AnthropicAnthropicSan Francisco, CA

TPU Kernel Engineer

Designs and optimizes TPU kernels to address performance issues in ML research, training, and inference systems. Provides feedback on model impacts and solves large-scale systems problems, requiring deep accelerator expertise.

280k – 850k
HybridML Engineering

About the role

You may be a good fit if you:

  • Have significant experience optimizing ML systems for TPUs, GPUs, or other accelerators
  • Are results-oriented, with a bias towards flexibility and impact
  • Pick up slack, even if it goes outside your job description
  • Enjoy pair programming (we love to pair!)
  • Want to learn more about machine learning research
  • Care about the societal impacts of your work

Strong candidates may also have experience with:

  • High performance, large-scale ML systems
  • Designing and implementing kernels for TPUs or other ML accelerators
  • Understanding accelerators at a deep level, e.g. a background in computer architecture
  • ML framework internals
  • Language modeling with transformers

Representative projects:

  • Implement low-latency, high-throughput sampling for large language models
  • Adapt existing models for low-precision inference
  • Build quantitative models of system performance
  • Design and implement custom collective communication algorithms
  • Debug kernel performance at the assembly level

Logistics

Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience.

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Annual Salary: $280,000 — $850,000 USD

Skills

TpuGPUKernel OptimizationMl SystemsComputer ArchitectureMl FrameworksTransformersCollective CommunicationLow-Precision InferenceAssembly

Similar roles

ML Engineering jobs
Zoox

Manager, RL Algorithms & Decoder

ZooxFoster City, CA

Lead a team developing large-scale RL and ML models for autonomous vehicle behavior planning and driving decisions. Requires RL/ML expertise, production ML pipeline experience, and 3+ years in leadership.

277k – 349k
Hybrid5+ YOEML Engineering
OpenAI

Software Engineer, Workload Enablement

OpenAISan Francisco, CA +1

Software Engineer enabling production AI workloads on new hardware platforms through porting, benchmarking, stress testing, and performance optimization. Requires 5+ years in ML systems, distributed training, PyTorch, and RDMA/NCCL expertise.

293k – 455k
Hybrid5+ YOEML Engineering
OpenAI

Research Engineer, Retrieval & Search, Applied Engineering

OpenAISan Francisco, CA

Develop and deploy retrieval and search algorithms for OpenAI's API and ChatGPT, collaborating with research teams on production systems for millions of users. Requires experience with ML systems, vector databases, and large-scale search.

293k – 585k
On-siteML Engineering
OpenAI

Distributed Training Engineer, Sora

OpenAISan Francisco, CA

Distributed Training Engineer optimizes training throughput for video foundation models, enabling researcher experiments with efficient architectures. Requires strong Python skills, distributed systems expertise, and performance profiling.

293k – 490k
HybridML Engineering
OpenAI

Machine Learning Engineer, Integrity

OpenAISan Francisco, CA

Deploys state-of-the-art ML models and fine-tunes LLMs in production to enhance platform integrity and safety against adversarial threats. Requires Master's/PhD, deep learning expertise, PyTorch/TensorFlow proficiency.

266k – 555k
On-siteML Engineering