# Forward Deployed Machine Learning Engineer

**Company:** [Protege](https://hotfix.jobs/companies/protege)
**Location:** Remote
**Role:** ML Engineering
**Experience:** 4+ years
**Skills:** Machine Learning, Model Evaluation, Backend Infrastructure, Data Pipelines, Benchmarking, LLMs, Agentic Systems, Reinforcement Learning, Code Execution, Orchestration
**Posted:** 2026-08-05

> Builds benchmarks, model evaluations, and backend infrastructure for an AI data platform’s Benchmarks and Evaluations vertical. The role requires 4+ years of engineering experience, hands-on model evaluation, and prior ownership of backend and infrastructure systems.

## Job Description

## Responsibilities

### Build the Evaluation Foundation
- Partner with the GM and early customers to define strong evaluations across domains.
- Design and build benchmarks with researchers.
- Establish standards for processing different modalities.

### Own Infrastructure
- Build backend infrastructure for the vertical, including data pipelines, execution environments, storage, and orchestration.
- Create sandboxed environments for agentic evaluations involving tools, code execution, and multi-step tasks.

### Move from Iteration to Product
- Identify repeatable evaluation patterns, infrastructure gaps, and product opportunities from live engagements.
- Partner with the research team on domain-specific data and research questions.
- Own the engineering component of customer engagements end to end.

## Requirements
- 4+ years of engineering experience.
- Hands-on machine learning experience evaluating models.
- Previous ownership of backend and infrastructure systems.
- High tolerance for ambiguity and a bias toward action.
- Ability to work with urgency in a fast-paced environment.
- Strong written communication.

## Nice-to-Haves
- Experience building benchmarks, evaluations, or human-data pipelines for large language models.
- Experience at a frontier lab, evaluation-focused team, or research organization.
- Founding or early-engineer experience at a fast-moving startup.
- Familiarity with agentic systems, reinforcement-learning environments, code-execution sandboxes, and TEE/TREs.

## Compensation and Benefits
- Compensation and benefits information was not provided in the posting.

## Similar jobs

- [Research Software Engineer, Post Training](https://hotfix.jobs/jobs/168e3c8f-8577-4482-bf94-91b3d11744ba) - Thinking Machines Lab - San Francisco, CA - $350k – $475k/yr
- [Software Engineer, AI for Chip Design](https://hotfix.jobs/jobs/abfb017d-1ce2-4d24-901d-16084eb7b3bc) - OpenAI - San Francisco, CA - $266k – $468k/yr
- [AI Software Engineer](https://hotfix.jobs/jobs/c9a0e889-a36e-488f-87d0-e9c27ab63bf0) - Rollstack - Remote
- [Machine Learning Engineer, Ranking & Retrieval](https://hotfix.jobs/jobs/adb5411d-8bfc-48b8-a8e7-15cbf5ea21b2) - ClickUp - Remote - $200k – $250k/yr
- [Machine Learning Engineer III](https://hotfix.jobs/jobs/2359be26-5005-4fa7-94c9-8a86066a6bb5) - PathAI - Boston, MA - $131k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/c62d5cec-a30c-4322-ae29-13d7426251d6
**Canonical:** https://hotfix.jobs/jobs/c62d5cec-a30c-4322-ae29-13d7426251d6