# Machine Learning Enginer, Core Evaluations

**Company:** [Cantina](https://hotfix.jobs/companies/cantina)
**Location:** Remote
**Role:** ML Engineering
**Experience:** 3+ years
**Skills:** Asr, Tts, Model Evaluation, User Studies, Mechanical Turk, Model Training, Fine-Tuning, Statistics, Python, Dashboards
**Posted:** 2026-04-29

> Designs evaluation pipelines, metrics, and user studies for speech generation and recognition models (ASR/TTS). Trains evaluation models, builds dashboards, and collaborates with ML, data, and product teams to improve performance on large-scale systems.

## Job Description

## Responsibilities
- Design model evaluation pipelines for models in development and production.
- Design user studies for subjective model evaluations.
- Convert requirements into measurable metrics.
- Design and develop automated evaluation dashboards to monitor model performances and compare results.
- Train new models to capture new and different evaluation metrics.
- Communicate with model team to design better models based on evaluation results.
- Communicate with data team to decide data needed to improve model performance.
- Communicate with product manager to ensure product requirements are correctly measured.
- Help grow the evaluation team as founding member and lead it in the future.

## Requirements
- Strong experience designing metrics that capture model performance.
- Strong experience designing user studies on Mechanical Turk or similar platforms.
- Strong experience with model training and fine-tuning for evaluation.
- Strong statistical knowledge to compare evaluation results and make decisions.
- Very strong engineering and programming skills.
- Experience training **ASR** and **TTS** models.
- Experience at ML teams working on large-scale problems (>3B models with >1m hours of data).

## Similar roles

- [CoDesign & NextGen Performance Engineer](https://hotfix.jobs/jobs/2cb728b7-a9ea-44b0-b16a-47364021f7be) - Cerebras Systems - Sunnyvale, CA
- [Research Engineer, Privacy](https://hotfix.jobs/jobs/3220c5d0-0e5f-4869-b133-1ed126b4208a) - OpenAI - San Francisco, CA - $380k – $445k/yr
- [Research Engineer](https://hotfix.jobs/jobs/b4d18018-e64d-4828-a8b4-303225328e17) - Console - San Francisco, CA - $200k – $350k/yr
- [Software Engineer, AI Platform](https://hotfix.jobs/jobs/7ddad000-3e1c-47cb-a45b-31d8e72abc4f) - Notion - San Francisco, CA - $180k – $201k/yr
- [Machine Learning Engineer](https://hotfix.jobs/jobs/97713038-58cb-46c5-a9c7-0e1554e1ba4f) - Liftoff - Remote - $215k – $275k/yr

**Apply:** https://hotfix.jobs/jobs/7a052c17-f137-4536-bfdb-02e50f113abb
**Canonical:** https://hotfix.jobs/jobs/7a052c17-f137-4536-bfdb-02e50f113abb