# Applied Research - Evals & Data

**Company:** [Prime Intellect](https://hotfix.jobs/companies/prime-intellect)
**Location:** New York, NY
**Role:** ML Engineering
**Salary:** $150k – $300k/yr
**Skills:** Reinforcement Learning, Post-Training, RLHF, Rlvr, Grpo, Machine Learning, AI Agents, Evaluation Frameworks, Distributed Training, vLLM, Sglang, Ray, Docker, Kubernetes, Terraform
**Posted:** 2026-07-08

> Customer-facing applied research role focused on building AI agents, evaluation systems, and post-training workflows for frontier models. The role combines reinforcement learning, distributed infrastructure, applied data, and close collaboration with customers and research teams.

## Job Description

## Responsibilities
- Design and iterate on AI agents for workflow automation, reasoning-intensive tasks, and decision-making.
- Use applied deployment data to refine policies, improve reasoning, and enhance reliability and safety.
- Develop distributed systems, evaluation pipelines, coordination frameworks, and data workflows for feedback, model traces, and reward signals.
- Work directly with customers to understand workflows, data sources, bottlenecks, and technical requirements.
- Prototype and deploy agents, evaluation harnesses, data pipelines, and verifiers for real-world use cases.
- Translate customer insights and evaluation results into product roadmaps and research direction.
- Design and implement reinforcement learning and post-training methods, including RLHF, RLVR, and GRPO.
- Integrate data collection and analytics into post-training to identify regressions, emergent skills, and alignment opportunities.
- Prototype multi-agent and memory-augmented systems.
- Extend agent frameworks and architect distributed training and inference pipelines.
- Develop observability and monitoring using metrics and tracing tools.

## Requirements
- Strong machine learning engineering background with experience in post-training, reinforcement learning, or large-scale model alignment.
- Experience with applied data workflows and evaluation frameworks for large models or agents, such as SWE-Bench, HELM, EvalFlow, or internal evaluation pipelines.
- Deep expertise in distributed training and inference frameworks, such as vLLM, SGLang, Ray, or Accelerate.
- Experience deploying containerized systems at scale with Docker, Kubernetes, and Terraform.
- Track record of research contributions through publications, open-source contributions, or benchmarks.
- Strong interest in reasoning, measurement, and practical agentic AI systems.

## Compensation and Benefits
- Cash compensation: $150,000–$300,000 plus equity incentives.
- Flexible work arrangement; remote or San Francisco options.
- Visa sponsorship and relocation support.
- Professional development budget.
- Team off-sites and conference attendance.

## Similar jobs

- [AI Engineer, Enablement](https://hotfix.jobs/jobs/6ae315a1-a605-45dc-b1ee-88fa8e9dee24) - LangChain - New York, NY - $150k – $195k/yr
- [Member of Technical Staff — Frontier Data](https://hotfix.jobs/jobs/20efe17f-aa7c-401b-8add-7086d4571fba) - Roboflow - Remote - $150k – $300k/yr
- [Algorithm Engineer](https://hotfix.jobs/jobs/3bef67e8-d4e7-4866-a9b8-6c7863fe2e96) - Beacon Biosignals - Remote - $150k – $170k/yr
- [Software Engineer - Prediction and Planning ML](https://hotfix.jobs/jobs/21b9c778-e1ae-4695-b26d-fec68ea8a8cc) - Applied Intuition - Sunnyvale, CA - $151k – $258k/yr
- [Software Engineer, AI Platform](https://hotfix.jobs/jobs/7dcee5ac-38bb-4da0-b399-0b5896976722) - Fab2 - Austin, TX - $140k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/e16e3ab5-c714-4e6b-942a-5a8b216930c5
**Canonical:** https://hotfix.jobs/jobs/e16e3ab5-c714-4e6b-942a-5a8b216930c5