# AI Application Engineer

**Company:** [Ema](https://hotfix.jobs/companies/ema)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Skills:** Python, Agent Development, AI Agents, Machine Learning, Healthcare Ai
**Posted:** 2026-08-18

> Measures and improves healthcare AI agents in production by instrumenting performance, diagnosing quality issues, and designing experiments with clinical experts. The role requires Python, analytical judgment, comfort with ambiguity, and interest in healthcare.

## Job Description

## Responsibilities
- Measure and improve the performance of healthcare AI Employees in production.
- Instrument agent performance and identify quality breakdowns.
- Design experiments to improve agent quality and patient outcomes.
- Partner with clinical experts to validate improvements.
- Operate effectively with incomplete information.

## Requirements
- Strong analytical judgment.
- Python proficiency.
- Experience with agent lead development.
- Genuine interest in the healthcare domain.

## Nice-to-Haves
- Clinical experience.

## Compensation and Benefits
- Part-time paid internship or contract engagement.
- Weekly syncs in the Bay Area office.
- Compensation is determined by location, level, job-related knowledge, skills, and experience.
- Certain roles may be eligible for variable compensation, equity, and benefits.

## Similar jobs

- [Research Software Engineer, Post Training](https://hotfix.jobs/jobs/168e3c8f-8577-4482-bf94-91b3d11744ba) - Thinking Machines Lab - San Francisco, CA - $350k – $475k/yr
- [Software Engineer, AI for Chip Design](https://hotfix.jobs/jobs/abfb017d-1ce2-4d24-901d-16084eb7b3bc) - OpenAI - San Francisco, CA - $266k – $468k/yr
- [AI Software Engineer](https://hotfix.jobs/jobs/c9a0e889-a36e-488f-87d0-e9c27ab63bf0) - Rollstack - Remote
- [Machine Learning Engineer, Ranking & Retrieval](https://hotfix.jobs/jobs/adb5411d-8bfc-48b8-a8e7-15cbf5ea21b2) - ClickUp - Remote - $200k – $250k/yr
- [Machine Learning Engineer III](https://hotfix.jobs/jobs/2359be26-5005-4fa7-94c9-8a86066a6bb5) - PathAI - Boston, MA - $131k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/326838b7-401d-4ef0-b056-2ba8c3ed04ba
**Canonical:** https://hotfix.jobs/jobs/326838b7-401d-4ef0-b056-2ba8c3ed04ba