# Senior Applied AI Engineer

**Company:** [Roger Healthcare](https://hotfix.jobs/companies/roger-healthcare)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $200k – $250k/yr
**Experience:** 7+ years
**Skills:** LLMs, Fine-Tuning, Model Evaluation, Agentic Systems, Inference Infrastructure, Observability, Python, PyTorch, Transformers
**Posted:** 2026-07-09

> Senior Applied AI Engineer building the core intelligence layer for Roger, an AI platform for home health clinicians. Responsibilities include training/fine-tuning LLMs on proprietary clinical data, building rigorous eval and monitoring systems, and shipping reliable agentic LLM workflows that improve patient care.

## Job Description

## What You'll Do
- Train and fine-tune open source models, leveraging our vast proprietary dataset to push accuracy beyond what off-the-shelf models can do.
- Build eval datasets and pipelines that let us measure model accuracy rigorously and improve it continuously.
- Design how we measure accuracy in the first place: the metrics, harnesses, and feedback loops that turn real clinical outcomes into measurable model improvements.
- Build scalable, cost-efficient inference infrastructure with great monitoring and observability.
- Build better agentic infrastructure and partner on the interfaces that turn model capability into a great clinician experience.
- Stay at the frontier: keep up with the latest research, frontier model capabilities, and open source frameworks, and bring the best of it into production.
- Prototype quickly, then harden into scalable, secure, and reliable production systems.

## You Might Be a Good Fit If You Have
- 7+ years of professional software engineering experience, with meaningful depth in AI/ML.
- Experience training, fine-tuning, or evaluating LLMs and open source models, with real opinions about what works and what does not.
- Shipped real AI software to real users. You can describe something you built, what broke, and how you fixed it.
- Strong instincts for evals, observability, and the feedback loops that turn user feedback into measurable improvement.
- Experience building agentic systems: tool use, generator and critic loops, planners and executors, and orchestration where one agent's output drives another's work.
- Comfort building infrastructure that is fast, reliable, and cost-efficient at scale.
- Startup experience shipping real features in high-growth environments.
- A product mindset, comfort across the stack, and the ability to operate in ambiguity without a clean spec.
- High standards for reliability and accuracy when real clinicians and patients depend on your work.

## Why Join Us?
- Platinum health, dental, and vision insurance
- Flexible PTO
- Be at the forefront of LLM innovation in healthcare
- Founded by AI Researchers from Cornell and Amazon Alexa
- Make a tangible difference in the lives of clinicians and patients
- Work on a mission that matters, backed by AI innovation and top-tier investors

## Similar roles

- [Senior Software Engineer](https://hotfix.jobs/jobs/d09d15d2-e8db-4410-8432-411e1731679e) - Traba - New York, NY - $200k – $240k/yr
- [Senior Software Engineer, Build](https://hotfix.jobs/jobs/f9da1ebf-fa44-456b-84fa-e08ad0706de2) - Astronomer - New York, NY - $200k – $230k/yr
- [Senior Software Engineer — LLM Post-Training Platform](https://hotfix.jobs/jobs/18eb951a-f28d-45af-bc44-7a715505e791) - Snowflake - Bellevue, WA - $200k – $288k/yr
- [Senior Software Engineer, Applied ML](https://hotfix.jobs/jobs/af80c313-fc0a-40d5-ba60-433c42cd252d) - Current - New York, NY - $200k – $250k/yr
- [Senior AI Engineer](https://hotfix.jobs/jobs/efb43ece-5643-4e58-a385-3eb6c12a06c0) - Socure - Carson City, NV - $200k – $230k/yr

**Apply:** https://hotfix.jobs/jobs/2ee355ea-77df-4a9a-bab1-4a96c2ed3514
**Canonical:** https://hotfix.jobs/jobs/2ee355ea-77df-4a9a-bab1-4a96c2ed3514