# Research Engineer, Pretraining

**Company:** [Anthropic](https://hotfix.jobs/companies/anthropic)
**Location:** London, United Kingdom
**Role:** ML Engineering
**Salary:** £260k – £630k/yr
**Skills:** Python, PyTorch, Machine Learning, LLMs, Transformer Architectures, GPU, Kubernetes, Reinforcement Learning, ETL, Distributed Training, Model Architecture, Data Processing, Optimizer Development, Linux Os Internals, Developer Tooling
**Posted:** 2026-08-03

> Research Engineer on a pretraining team, developing and scaling large language models through research, experimentation, infrastructure optimization, and model engineering. Requires advanced ML or computer science education, strong software engineering skills, and expertise in Python and deep learning frameworks.

## Job Description

## Responsibilities
- Conduct research and implement solutions in model architecture, algorithms, data processing, and optimizer development.
- Independently lead small research projects and collaborate on larger initiatives.
- Design, run, and analyze scientific experiments to advance understanding of large language models.
- Optimize and scale training infrastructure for efficiency and reliability.
- Develop and improve developer tooling.
- Contribute across the stack, from low-level optimizations to high-level model design.

## Requirements
- Advanced degree (MS or PhD) in Computer Science, Machine Learning, or a related field.
- Strong software engineering skills and experience building complex systems.
- Expertise in Python and experience with deep learning frameworks, preferably PyTorch.
- Familiarity with large-scale machine learning, particularly language models.
- Ability to balance research goals with practical engineering constraints.
- Strong problem-solving, communication, and collaboration skills.

## Nice-to-haves
- Experience with high-performance, large-scale ML systems.
- Familiarity with GPUs, Kubernetes, and operating-system internals.
- Experience with language modeling and Transformer architectures.
- Knowledge of reinforcement learning techniques.
- Background in large-scale ETL processes.

## Sample Projects
- Optimizing throughput for novel attention mechanisms.
- Comparing compute efficiency of Transformer variants.
- Preparing large-scale datasets for efficient model consumption.
- Scaling distributed training jobs to thousands of GPUs.
- Designing fault-tolerance strategies for training infrastructure.
- Creating visualizations of model internals, such as attention patterns.

## Compensation and Benefits
- Annual salary: £260,000–£630,000 GBP.
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Collaborative office environment.
- Visa sponsorship may be available.

## Work Arrangement
- Staff are expected to work from an office at least 25% of the time; some roles may require more office time.

## Similar jobs

- [Research Engineer, Pretraining Scaling](https://hotfix.jobs/jobs/155ea3ee-e487-4cb8-8343-cab2d40cf642) - Anthropic - London, United Kingdom - £260k – £630k/yr
- [AI Engineer (Assistant)](https://hotfix.jobs/jobs/4c7ec3aa-a4bf-4dc9-987f-c541087f251b) - Build - New York, NY - $125k – $225k/yr
- [AI Engineer - Assistant Experience](https://hotfix.jobs/jobs/00d11204-96cf-4c85-a12f-9058f0581c15) - Build - New York, NY - $120k – $240k/yr
- [AI Software Engineer](https://hotfix.jobs/jobs/c9a0e889-a36e-488f-87d0-e9c27ab63bf0) - Rollstack - Remote
- [Applied AI Engineer, Digital Natives](https://hotfix.jobs/jobs/74eb3e31-bab1-479e-90e1-2e172658343a) - OpenAI - London, United Kingdom

**Apply:** https://hotfix.jobs/jobs/1d6e5867-6d9a-45b0-a246-2b247f4eef23
**Canonical:** https://hotfix.jobs/jobs/1d6e5867-6d9a-45b0-a246-2b247f4eef23