# Member of Technical Staff

**Company:** [xAI](https://hotfix.jobs/companies/xai)
**Location:** Palo Alto, CA
**Role:** ML Engineering
**Experience:** 5+ years
**Skills:** Python, C++, Rust, PyTorch, JAX, CUDA, Llm Inference, Quantization, Distributed Systems, Sglang, vLLM
**Posted:** 2026-07-06

> Engineer optimizing RL inference stack for workloads from ablations to production training. Requires experience with large-scale distributed systems, LLM inference, and proficiency in Python/C++/Rust with PyTorch/JAX/CUDA.

## Job Description

## Responsibilities
- Design and optimize our inference stack for all shapes of RL workloads at xAI, from small scale ablations to production training runs.
- Analyze, profile and address performance bottlenecks in large scale RL systems.
- Work closely with the modelling team to efficiently implement novel RL techniques and algorithms.

## Basic Qualifications
- Experience in building, debugging, and optimizing efficiency of large-scale distributed systems.
- Experience in LLM inference.
- Proficiency in programming languages such as Python, C++ and/or Rust; frameworks such as PyTorch, Jax, CUDA.
- Willingness to dive deep and solve hardcore problems at all levels of the stack.

## Preferred Skills and Experience
- Strong knowledge in quantization and numerics in LLM inference and training.
- Experience in developing inference engines, e.g. SGLang, vLLM.

## Similar roles

- [Member of Technical Staff](https://hotfix.jobs/jobs/dd7c8bc4-741a-45d5-91a8-e6b1c4ad67e0) - xAI - Palo Alto, CA - $180k – $440k/yr
- [Staff Software Engineer, AI & App Experience](https://hotfix.jobs/jobs/78128221-8199-41cd-9c63-502d3f61d603) - Chime - New York, NY - $223k – $308k/yr
- [Staff + Senior Software Engineer, Cloud Inference Launch Engineering](https://hotfix.jobs/jobs/18b08a6a-5359-4836-b72e-c641fa718b04) - Anthropic - San Francisco, CA - $320k – $485k/yr
- [Senior Staff Software Engineer, Legal Automation](https://hotfix.jobs/jobs/7870d3e1-ebec-4f7b-9ae5-c62926a06d6e) - Coinbase - Remote - $254k – $299k/yr
- [Staff Machine Learning Engineer, Computer Vision](https://hotfix.jobs/jobs/2969c5c0-8479-43bb-b9b6-f8df93b528d7) - Pinterest - San Francisco, CA - $189k – $390k/yr

**Apply:** https://hotfix.jobs/jobs/9cf66788-70c1-4e60-a9d9-1190e668f9e1
**Canonical:** https://hotfix.jobs/jobs/9cf66788-70c1-4e60-a9d9-1190e668f9e1