# Software Engineer, Trainium

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $295k – $380k/yr
**Experience:** 3+ years
**Skills:** Aws Trainium, Aws Neuron Sdk, Systems Programming, GPU, Tpu, Performance Engineering, Compilers, Kernels, PyTorch, JAX, Llvm, Mlir, Xla, Triton, Inference Systems
**Posted:** 2026-08-19

> Build and optimize OpenAI’s inference stack for AWS Trainium across high-performance kernels, compilers, runtimes, and model execution. The role requires systems programming and accelerator experience, with opportunities to solve end-to-end performance problems for frontier-scale AI models.

## Job Description

## Responsibilities
- Build and optimize OpenAI's inference stack for AWS Trainium.
- Develop high-performance kernels for critical model operations and workloads.
- Extend and improve compiler support to efficiently target Trainium hardware.
- Build systems to execute and optimize model forward passes on Trainium.
- Profile workloads and identify bottlenecks across kernels, compiler-generated code, runtime, and model execution.
- Partner with inference and ML systems teams to bring new models and architectures onto Trainium.
- Work across the hardware/software boundary to unlock performance from specialized AI accelerators.
- Own complex performance and systems problems end-to-end, from investigation through production deployment.

## Requirements
- **3+ years** of relevant engineering experience, ideally in ML systems, compilers, kernels, runtimes, or performance engineering.
- Strong systems programming fundamentals and experience writing performance-critical software.
- Experience with GPU, TPU, Trainium, or other specialized accelerator architectures.
- Ability to reason about performance across hardware, kernels, compilers, and ML frameworks.
- Ability to own technically ambiguous problems end-to-end and learn new hardware and software domains.

## Nice-to-Haves
- AWS Trainium or AWS Neuron SDK experience.
- Contributions to PyTorch or JAX.
- Experience with LLVM, MLIR, XLA, or Triton.
- Experience developing kernels for specialized accelerators.

## Similar jobs

- [Applied AI Engineer, Beneficial Deployments](https://hotfix.jobs/jobs/c38bca51-e1c4-4f65-8790-b09d52d8169c) - Anthropic - San Francisco, CA - $280k – $320k/yr
- [Software Engineer, AI for Chip Design](https://hotfix.jobs/jobs/abfb017d-1ce2-4d24-901d-16084eb7b3bc) - OpenAI - San Francisco, CA - $266k – $468k/yr
- [Software Engineer, Model Runtime](https://hotfix.jobs/jobs/7f549613-3d04-42b8-b691-8ed7c2d9ecd1) - OpenAI - San Francisco, CA - $266k – $445k/yr
- [Machine Learning Engineer](https://hotfix.jobs/jobs/22efd49a-a0e5-48d7-aea3-8a7bdd7d7337) - Hyperbound - San Francisco, CA - $260k – $300k/yr
- [Machine Learning Engineer, Multimodal Perception and Authentication](https://hotfix.jobs/jobs/26314e6e-423f-4a3f-b400-ee0b56429f64) - OpenAI - San Francisco, CA - $342k – $399k/yr

**Apply:** https://hotfix.jobs/jobs/5e1a8341-f0e9-45c8-8492-12782b38f079
**Canonical:** https://hotfix.jobs/jobs/5e1a8341-f0e9-45c8-8492-12782b38f079