Skip to content
Roger HealthcareRoger HealthcareSan Francisco, CA

Senior Applied AI Engineer

Senior Applied AI Engineer building the core intelligence layer for Roger, an AI platform for home health clinicians. Responsibilities include training/fine-tuning LLMs on proprietary clinical data, building rigorous eval and monitoring systems, and shipping reliable agentic LLM workflows that improve patient care.

200k – 250k
On-site7+ YOEML Engineering

About the role

What You'll Do

  • Train and fine-tune open source models, leveraging our vast proprietary dataset to push accuracy beyond what off-the-shelf models can do.
  • Build eval datasets and pipelines that let us measure model accuracy rigorously and improve it continuously.
  • Design how we measure accuracy in the first place: the metrics, harnesses, and feedback loops that turn real clinical outcomes into measurable model improvements.
  • Build scalable, cost-efficient inference infrastructure with great monitoring and observability.
  • Build better agentic infrastructure and partner on the interfaces that turn model capability into a great clinician experience.
  • Stay at the frontier: keep up with the latest research, frontier model capabilities, and open source frameworks, and bring the best of it into production.
  • Prototype quickly, then harden into scalable, secure, and reliable production systems.

You Might Be a Good Fit If You Have

  • 7+ years of professional software engineering experience, with meaningful depth in AI/ML.
  • Experience training, fine-tuning, or evaluating LLMs and open source models, with real opinions about what works and what does not.
  • Shipped real AI software to real users. You can describe something you built, what broke, and how you fixed it.
  • Strong instincts for evals, observability, and the feedback loops that turn user feedback into measurable improvement.
  • Experience building agentic systems: tool use, generator and critic loops, planners and executors, and orchestration where one agent's output drives another's work.
  • Comfort building infrastructure that is fast, reliable, and cost-efficient at scale.
  • Startup experience shipping real features in high-growth environments.
  • A product mindset, comfort across the stack, and the ability to operate in ambiguity without a clean spec.
  • High standards for reliability and accuracy when real clinicians and patients depend on your work.

Why Join Us?

  • Platinum health, dental, and vision insurance
  • Flexible PTO
  • Be at the forefront of LLM innovation in healthcare
  • Founded by AI Researchers from Cornell and Amazon Alexa
  • Make a tangible difference in the lives of clinicians and patients
  • Work on a mission that matters, backed by AI innovation and top-tier investors

Skills

LLMsFine-TuningModel EvaluationAgentic SystemsInference InfrastructureObservabilityPythonPyTorchTransformers

Similar roles

ML Engineering jobs
Traba

Senior Software Engineer

TrabaNew York, NY +1

Build and own production AI agent systems (harnesses, evals, orchestration) on frontier LLMs for industrial supply chain workflows at Traba. Requires 5+ years software engineering with 1+ year shipping LLM/agent features, strong Python/TS, and high-agency customer immersion.

200k – 240k
Hybrid5+ YOEML Engineering
Astronomer

Senior Software Engineer, Build

AstronomerNew York, NY

Build and scale Astronomer's AI-powered global context layer for data, focusing on semantic search, retrieval, code generation, and applied AI for data engineering workflows. Requires 5+ years software engineering experience with Python or Go, plus strong interest in LLMs and data tools.

200k – 230k
Hybrid5+ YOEML Engineering
Snowflake

Senior Software Engineer — LLM Post-Training Platform

SnowflakeBellevue, WA

Build and scale Snowflake's Cortex Training LLM post-training platform, handling distributed GPU scheduling, orchestration, and productionizing research for enterprise-scale model adaptation.

200k – 288k
On-site5+ YOEML Engineering
Current

Senior Software Engineer, Applied ML

CurrentNew York, NY

Senior Software Engineer applying ML/AI techniques to fintech problems like fraud detection and user conversion. Requires 5+ years backend engineering (Java/JVM) and 2+ years deploying production ML models.

200k – 250k
On-site5+ YOEML Engineering
Socure

Senior AI Engineer

SocureCarson City, NV +1

Build and deploy production-grade agentic AI systems and automation workflows that drive efficiency across sales, marketing, finance, and other business functions. Partner with stakeholders to identify high-impact use cases and deliver reliable, observable LLM-powered solutions.

200k – 230k
Hybrid8+ YOEML Engineering