# Research Engineer, Takeoff Intel

**Company:** [Anthropic](https://hotfix.jobs/companies/anthropic)
**Location:** San Francisco, CA
**Role:** AI Research
**Salary:** $350k – $850k/yr
**Skills:** LLMs, Machine Learning, Data Pipelines, Data Processing, Evaluation Harnesses, Benchmark Infrastructure, Telemetry, Python, Research Libraries
**Posted:** 2026-09-08

> Research Engineer building large-scale AI capability evaluations, telemetry, data pipelines, and analysis tools for Anthropic’s Takeoff Intel team. The role requires hands-on large language model experimentation, rapid prototyping, data expertise, and strong research collaboration.

## Job Description

## Responsibilities
- Design, build, and run capability evaluations and measurement instruments at scale.
- Build data and analysis pipelines that transform large volumes of model outputs and telemetry into reliable metrics.
- Prototype new instruments rapidly, validate them, and determine which to retain.
- Review and supervise AI-written code.
- Collaborate with research scientists and partner teams to define meaningful measurements.
- Contribute to internal write-ups and public reporting.

## Requirements
- End-to-end experience shipping an evaluation, data product, or research library.
- Ability to prototype quickly and discard code when appropriate.
- Experience handling messy, large-volume data without over-engineering.
- Experience running experiments on large language models.
- Ability to work from ambiguous research questions rather than detailed specifications.
- Strong written and verbal communication and close collaboration skills.

## Nice-to-haves
- Experience building LLM evaluation harnesses or benchmark infrastructure.
- Experience with large-scale machine learning or data infrastructure, including self-driving or observability systems.
- Experience building tools or libraries used by other researchers.
- Experience identifying errors in AI-written code.

## Compensation
- Annual salary: $350,000–$850,000 USD.

## Similar jobs

- [Research, Coding Agents](https://hotfix.jobs/jobs/53bac391-9bcb-48e0-84f9-2dbe7cd426b8) - Thinking Machines Lab - San Francisco, CA - $350k – $475k/yr
- [Research, Safety](https://hotfix.jobs/jobs/420d2360-0401-41e6-8665-9a5112542a0b) - Thinking Machines Lab - San Francisco, CA - $350k – $475k/yr
- [Researcher, Agent Safety, Oversight and System Mitigations](https://hotfix.jobs/jobs/4544e3bb-bb96-43d2-a96c-cd364b641660) - OpenAI - San Francisco, CA - $380k – $500k/yr
- [Researcher, Agent Safety, Training and Evaluations](https://hotfix.jobs/jobs/d80336da-e453-4999-9f26-85a125b679d9) - OpenAI - San Francisco, CA - $380k – $500k/yr
- [Research Scientist, Life Sciences](https://hotfix.jobs/jobs/c9d5ef0c-39c0-4e12-b2b6-d7f30615fb7e) - Anthropic - San Francisco, CA - $300k – $320k/yr

**Apply:** https://hotfix.jobs/jobs/398824a2-65cc-4e28-aaeb-26c3b6610876
**Canonical:** https://hotfix.jobs/jobs/398824a2-65cc-4e28-aaeb-26c3b6610876