# Automation Lead, AI Operations

**Company:** [Fetch](https://hotfix.jobs/companies/fetch)
**Location:** Remote
**Role:** ML Engineering
**Salary:** $97k – $114k/yr
**Experience:** 5+ years
**Skills:** LLMs, AI Workflows, Automation Platforms, Evaluation Frameworks, Datasets, System Design, Data Pipelines, APIs, Hitl Processes, Quality Measurement
**Posted:** 2026-04-14

> Leads automation and evaluation programs for AI Operations, architecting scalable workflows with LLMs, datasets, and quality systems. Requires 5+ years leading complex AI initiatives, cross-functional influence, and metrics-driven impact; familiarity with data pipelines preferred.

## Job Description

## Role Responsibilities
- Own programs: Lead complex, high-impact automation and evaluation initiatives across workflows or teams
- Design scalable solutions: Architect end-to-end workflows integrating datasets, evaluations, automations, and HITL processes
- Establish standards: Define best practices for datasets, evaluation methodologies, and quality measurement
- Drive cross-functional alignment: Influence priorities and partner with Engineering, Product, and AI teams to deliver solutions
- Improve systems at scale: Lead redesign of workflows, tooling, and processes to improve performance and durability
- Measure and communicate impact: Define success metrics and communicate performance and recommendations to leadership
- Elevate the team: Raise the bar through your work and actively mentor others by sharing approaches, guiding problem-solving, and enabling the team to build stronger automation and evaluation capabilities
- Drive innovation: Stay current on emerging tools and approaches; pilot and translate them into actionable improvements for the team

## Minimum Requirements
- 5+ years of experience and the proven ability to lead complex automation or evaluation initiatives across systems or teams
- Experience designing, building, and scaling evaluation frameworks, datasets, and quality systems at scale for LLMs or AI products
- Strong understanding of AI/LLM workflows, automation platforms, and system design
- Experience in influencing cross-functional stakeholders and aligning priorities
- Demonstrated ability to define metrics and drive measurable business impact

## Preferred Requirements
- Familiarity with data pipelines, APIs, or production systems
- Experience mentoring or leading technical contributors
- Background in AI Operations, applied AI, or process optimization

## Compensation
Base salary range: $97,000 - $114,000

## Similar roles

- [Senior Software Engineer](https://hotfix.jobs/jobs/4c99a2b5-fd8f-4ff5-8406-933272a4dd44) - Astera - Emeryville, CA - $100k – $400k/yr
- [Sr. Applied AI Engineer](https://hotfix.jobs/jobs/7a6b5cc5-dc8a-485b-b536-5bfc45b42dcd) - Zapier - Remote - $102k – $287k/yr
- [Senior Software Engineer, AI](https://hotfix.jobs/jobs/f5373a65-e352-47d7-87cb-80e609ab7454) - Navan - New York, NY - $113k – $252k/yr
- [Machine Learning Operations (MLOps) Architect - Generative Al Focus](https://hotfix.jobs/jobs/9e70326f-737f-4aac-bc22-bc9b9e1645cb) - Kapitus - Arlington, VA - $118k – $189k/yr
- [Senior Automation Specialist, AI Operations](https://hotfix.jobs/jobs/c96197f5-b0bd-4490-9530-ac8c381d9c8e) - Fetch - Remote - $75k – $85k/yr

**Apply:** https://hotfix.jobs/jobs/7060e745-ee31-4b28-9ebe-8c503703bfd4
**Canonical:** https://hotfix.jobs/jobs/7060e745-ee31-4b28-9ebe-8c503703bfd4