Skip to content
Ambience HealthcareAmbience HealthcareSan Francisco, CA

Staff ML Engineer, AI Platform

Builds ML platform infrastructure including evaluation/release gates, debug tooling, chart context retrieval, data pipelines, and model serving to accelerate AI improvements for clinical workflows. Requires 7+ years software engineering with 3+ in ML infra/platform, strong Python/TypeScript backend skills.

250k – 300k/yr
Hybrid7+ YOEML Engineering

About the role

What You’ll Own

Eval & Release Infrastructure

  • Automated graders and release gates that work across product pods
  • Unified eval dataset versioning and execution to replace fragmented workflows
  • Production quality monitoring with end-to-end tracing, shared metrics, and automated alerting

Debug Tooling

  • Encounter replay that reconstructs exact inference inputs (retrieved chart context, packed prompts, model versions) so teams reproduce issues without digging through logs
  • Diff views comparing known-good runs to regressions

Chart Context & Data Pipelines

  • The retrieval layer that pulls relevant patient history and assembles it into consistent model-ready inputs
  • Feedback loops that capture real-world usage and convert it into training signal
  • End-to-end latency instrumentation across every workflow step

Preference Infrastructure

  • The system that enables clinician and site-specific behavior across specialties
  • Different clinics want different defaults, different phrasing, different workflows. Build the platform that supports customization at scale

Model Serving

  • Performance and reliability layer for critical in-house models with clear SLOs, capacity planning, and regression alerts

Who You Are

  • 7+ years in software engineering, 3+ focused on ML infrastructure, platform engineering, or data systems
  • Staff-level scope: owned cross-cutting infrastructure, influenced technical direction across multiple teams
  • Strong backend fundamentals in Python, TypeScript, or similar
  • Built eval systems, data pipelines, or ML observability infrastructure
  • Comfortable on both the ML and Eng sides of MLOps
  • Track record of platform work that measurably accelerated other teams
  • In SF, 3x/week in-person

Compensation

Base compensation range of approximately $250,000-300,000 per year, exclusive of equity.

Skills

PythonTypeScriptML InfrastructureMLOpsData PipelinesEval SystemsObservabilityKubernetesRetrieval SystemsModel Serving

Similar roles

ML Engineering jobs
Axion

Staff Software Engineer, Agentic Platform

AxionSan Francisco, CA +1

Senior individual contributor architecting and scaling agentic LLM systems that turn messy manufacturing data into reliable root-cause insights. Owns orchestration, retrieval, evaluation, and guardrails for non-deterministic production systems.

250k – 270k/yr
Hybrid7+ YOEML Engineering
The Voleon Group

Member of Research Staff, Optimization

The Voleon GroupBerkeley, CA +1

Conduct optimization research and implement large-scale constrained optimization models that drive real-time trading decisions, working across the full research lifecycle from theory to production. Requires PhD-level coursework and strong applied research background in optimization.

250k – 275k/yr
Hybrid7+ YOEML Engineering
Nuance Labs

Member of Technical Staff — RL Research

Nuance LabsSeattle, WA

New/recent PhD to own RL and post-training for large-scale omni models. Build and scale the full RL/post-training stack including rollout, optimization, reward modeling, and evaluation for real-time audiovisual AI.

250k – 350k/yr
On-siteEntry levelML Engineering
Labelbox

Staff Software Engineer, AI Data Platform

LabelboxSan Francisco, CA

Staff-level engineer building AI data platform infrastructure, eval systems, and agent-first tooling for frontier labs. Requires 4+ years shipping production systems, full-stack experience, and deep TypeScript/Python proficiency.

250k – 280k/yr
Hybrid4+ YOEML Engineering
Nuance Labs

Member of Technical Staff — Model Optimization and Inference

Nuance LabsSeattle, WA

Optimize inference for real-time multimodal AI avatars. Specialize in LLM and diffusion model serving, KV cache strategies, quantization, and low-latency frameworks like vLLM and TensorRT-LLM.

250k – 350k/yr
On-site7+ YOEML Engineering