# Software Engineer, AI Data & Evaluation

**Company:** [Mercor](https://hotfix.jobs/companies/mercor)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $130k – $500k/yr
**Skills:** Ai/Ml Data Pipelines, Evaluation Frameworks, Training Data Systems, System Design, Synthetic Data Generation, Reinforcement Learning, Large-Scale Data Quality Systems
**Posted:** 2026-05-29

> As a Senior Software Engineer, AI Data & Evaluation, you will build data infrastructure and evaluation systems for frontier AI models. This role involves designing evaluation methodologies, building synthetic data generation systems, and architecting operational automation.

## Job Description

## About the Role
As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure and evaluation systems that power the next generation of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI industry ahead.

Software Engineers on this team are builders and innovators first. You will design and develop the evaluation methods and flywheels that drive continuous model improvement, engineer synthetic data pipelines and environments that generate high-signal training data at scale, and build the operational automation that keeps it all running with precision and efficiency. This role demands a product- and impact-oriented mindset, a bias toward shipping, and the ability to thrive at the intersection of data engineering, systems design, and applied AI research.

### You Will

*   Innovate and develop evaluation methodologies and flywheels that continuously improve data quality and model performance at scale.
*   Design and build synthetic data generation systems and simulation environments that produce high-signal, high-diversity training data for frontier AI models.
*   Architect and ship operational automation systems that maximize throughput, efficiency, and quality across the end-to-end data pipeline.
*   Collaborate cross-functionally with Operations, Research, and Product to translate evolving model needs into robust, scalable engineering solutions.
*   Own end-to-end delivery of critical systems — from prototyping novel ideas to scaling production infrastructure.

### What We're Looking For

*   Strong software engineering skills with a proven track record shipping production systems end-to-end.
*   Deep interest in and experience with AI/ML data pipelines, evaluation frameworks, or training data systems.
*   Systems thinking: ability to design for scalability, quality, and operational reliability simultaneously.
*   Comfort operating with ownership and pragmatism in fast-moving, ambiguous environments.
*   Effective communication and collaboration with engineering, research, and operations teams.
*   Experience with synthetic data generation, reinforcement learning environments, or large-scale data quality systems is highly valued.

### Why Mercor

*   **Impact:** Your work directly shapes the quality of data powering the world's leading AI labs' frontier models.
*   **Learning:** Get early, first-hand exposure to cutting-edge model capabilities months before they reach the market.
*   **Growth:** Work at the intersection of data engineering and AI research with fast paths to ownership and leadership.

### Benefits

*   Bi-annual performance bonus structure
*   Generous equity grant vested over 4 years
*   Up to $15k Relocation bonus
*   $10K proximity bonus (if you live within 0.5 miles of our office)
*   $1.5K monthly stipend for meals
*   Free Equinox membership
*   $200 monthly laundry reimbursement
*   $200 monthly personal wellness reimbursement
*   Health, Dental, Vision insurance

## Similar roles

- [Machine Learning Engineer, Marketplace](https://hotfix.jobs/jobs/3e2e2e2a-fe2a-489d-a805-0f6ceeb6e501) - Mercor - San Francisco, CA - $130k – $500k/yr
- [AI Product Engineer](https://hotfix.jobs/jobs/d71af7e2-0dad-46b5-840a-387ddd0ba9aa) - Clickhouse - Remote - $130k – $230k/yr
- [Machine Learning Engineer, Marketplace](https://hotfix.jobs/jobs/584c127f-d1c5-4a8f-8eca-3b2456f4b8dd) - Mercor - San Francisco, CA - $130k – $500k/yr
- [Software Engineer, Applied AI](https://hotfix.jobs/jobs/349cfba5-2a3d-4126-bdba-2562ed149982) - Mercor - San Francisco, CA - $130k – $500k/yr
- [Software Engineer, Applied AI](https://hotfix.jobs/jobs/c57814db-90f1-4f3a-bc4f-bc5f4d13f13a) - Mercor - San Francisco, CA - $130k – $500k/yr

**Apply:** https://hotfix.jobs/jobs/e08f0816-d02c-43b7-97a9-bdba326e8bc1
**Canonical:** https://hotfix.jobs/jobs/e08f0816-d02c-43b7-97a9-bdba326e8bc1