# Environment Engineers

**Company:** [AfterQuery](https://hotfix.jobs/companies/afterquery)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $180k – $220k/yr
**Experience:** 1+ years
**Skills:** RLHF, Rlvr, Data Pipelines, Synthetic Data, Evaluation Frameworks, Dataset Quality Metrics, Ai Benchmarking, Model Alignment, Data Slices, Quantitative Analysis
**Posted:** 2026-04-13

> Designs datasets, evaluation rubrics, and reward signals for RLHF/RLVR pipelines to expose model failure modes and improve frontier AI capabilities. Partners with AI labs; requires 1-4 YOE and passion for data-driven model behavior.

## Job Description

## What You'll Do

- Design data slices and explore data shapes that expose meaningful model failure modes across domains like finance, code, and enterprise workflows
- Build and refine evaluation rubrics and reward signals for **RLHF** and **RLVR** training pipelines
- Model annotator behavior and run experiments to improve different model capabilities
- Develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on model alignment and capability
- Create and manage both real world & synthetic data pipelines
- Partner with lab research teams to translate their training objectives into concrete data and evaluation specifications

## What We're Looking For

- **1-4 YOE**
- Major plus if they've worked for/interned for any RL environment companies in the past or any AI safety or benchmarking orgs like METR, Artificial Analysis, etc.
- Genuine obsession with how data structure, selection, and quality drive model behavior
- Ability to design lightweight experiments, move fast, and extract actionable insights from messy results
- Former founders and early engineers at early stage startups are a plus. We don't filter on pedigree. We want people who can demonstrate they work hard, learn fast, and care deeply about getting the details right.

## Compensation

**$200k base + profit share (around 150% of base) + competitive equity**

## Similar roles

- [Forward-Deployed Engineer (CoE)](https://hotfix.jobs/jobs/9475b7fa-0d49-403f-b9dd-ef5750183509) - Tessera Labs - New York, NY - $180k – $233k/yr
- [Forward Deployed ML Engineer](https://hotfix.jobs/jobs/9213e459-6ba5-4b86-9bf1-0251688c4720) - Modal - New York, NY - $180k – $250k/yr
- [Machine Learning Engineer - 3D Sensor Simulation](https://hotfix.jobs/jobs/b2b77a62-42a8-439a-b3ea-2529a45a1807) - Zoox - Foster City, CA - $176k – $257k/yr
- [ML Engineer, Generative Video](https://hotfix.jobs/jobs/70497a05-ec28-442a-b182-4bb62ef208eb) - Mirage - New York, NY - $175k – $275k/yr
- [Machine Learning Engineer, Infrastructure](https://hotfix.jobs/jobs/c7e22a9c-0c09-40fd-a313-4a9c5b892d95) - Glean - $175k – $270k/yr

**Apply:** https://hotfix.jobs/jobs/95ac0613-5ae8-4b75-b3d0-139d6eca0eb6
**Canonical:** https://hotfix.jobs/jobs/95ac0613-5ae8-4b75-b3d0-139d6eca0eb6