Builds and optimizes RL training infrastructure, removes bottlenecks in the RL stack, and partners with researchers to accelerate model development at scale. Requires strong software engineering, ML infra experience, and comfort across the stack.
500k – 850k/yr
HybridML Engineering
About the role
Responsibilities
Build and improve the RL training infrastructure that researchers depend on day-to-day
Identify and remove bottlenecks across the RL stack: debugging, profiling, and rearchitecting where needed
Partner closely with researchers and with adjacent engineering teams (inference, sandboxing, and many more) to understand pain points and ship tooling that makes them faster
Own the reliability and performance of research runs end-to-end
Contribute to design decisions that shape how Anthropic does RL at scale
You may be a good fit if you
Have strong software engineering fundamentals and a track record of building performant, reliable systems
Have worked on ML infrastructure, distributed systems, or research tooling
Care about enabling other people's work and find leverage through platforms rather than individual experiments
Are comfortable operating across the stack, from low-level performance work to RL algorithms
Have a bias toward shipping and iterating quickly, with a mix of high agency and low ego
Strong candidates may also have
Experience with large-scale distributed training (RL, pre-training, or post-training)
Familiarity with JAX, PyTorch, or similar ML frameworks
A track record of operating at the edge of research and infra in a fast-moving environment
Logistics
Annual Salary: $500,000—$850,000 USD
Skills
Reinforcement LearningJAXPyTorchDistributed SystemsML InfrastructureResearch ToolingDistributed Training
Build and run evaluations to measure Claude's capabilities, safety, and performance. Design metrics, implement scalable distributed eval infrastructure and dashboards, debug training runs, and partner with researchers to characterize and improve AI systems.
500k – 850k/yr
Hybrid5+ YOEML Engineering
Research Engineer, Computer Use
AnthropicSan Francisco, CA +2
Research Engineer advancing Claude's computer use capabilities through experiments, RL environments, evaluations, and infrastructure for perception and agentic tasks. Requires Python, ML training/evaluation experience, and a focus on safe AI.
500k – 850k/yr
Hybrid5+ YOEML Engineering
Research Engineer, Privacy
OpenAISan Francisco, CA
Research Engineer on OpenAI's Privacy team designing and prototyping privacy-preserving ML algorithms like differential privacy and federated learning at scale. Requires hands-on PETs experience, fluency in PyTorch/JAX, and a track record implementing or publishing novel privacy work.
380k – 445k/yr
HybridML Engineering
TL, Research Inference
OpenAISan Francisco, CA
Leads development of high-performance inference systems for large-scale AI models, optimizing execution paths, distributed GPU inference, and operators. Partners with research teams to enable efficient exploration of new architectures grounded in real scalability constraints.
380k – 555k/yr
On-siteML Engineering
Research Infrastructure Engineer
Thinking Machines LabSan Francisco, CA
Build and operate research infrastructure like evaluation frameworks, RL training systems, and experiment tracking platforms. Partner directly with ML researchers to identify bottlenecks, ensure high adoption of tools, and accelerate research velocity.