Skip to content
Garner HealthGarner HealthNew York City, NY

Senior Machine Learning Operations Engineer

Build and operate production ML systems and platform components for healthcare technology, partnering with ML and data science teams on model deployment, observability, and reliability.

256k – 285k/yr
Hybrid5+ YOEML Engineering

About the role

What you will do

  • Help ensure the reliability, performance, functionality, and cost-efficiency of Garner's production ML systems, contributing to SLOs, observability, and on-call responsibilities.
  • Build key components of Garner's ML platform, including data infrastructure (such as a feature store, model registry, and CI/CD for models) and standardized service patterns.
  • Implement ML-specific CI/CD pipelines: Help transition our deployment process from manual notebook hand-offs to automated, PR-driven CI/CD workflows that include automated data quality checks and statistical model validation prior to deployment.
  • Drive down cost and latency through improved architecture, hardware choices, and model optimization as appropriate.
  • Contribute to the workflows, standards, and KPIs that support a growing MLOps function, helping teammates and stakeholders quickly identify the health of the team's products and focus on areas where issues reside.
  • Help establish drift monitoring: Design and implement automated data drift and concept drift monitoring systems that alert the team when models degrade, laying the groundwork for future Continuous Training (CT) architectures.

The ideal candidate has

  • 5+ years of software engineering experience, with meaningful time spent operating ML or data-intensive systems in production.
  • Hands-on experience with the modern ML production stack: model serving (e.g., Sagemaker, Triton, or equivalent), feature stores, model registries, and CI/CD for ML.
  • Strong infrastructure and platform engineering fundamentals: Kubernetes, containerization, cloud (AWS preferred), Terraform/IaC, observability, and incident response.
  • Experience building ML platforms or significant components of one (not strictly consuming SaaS), with sound judgment around when to build vs. buy.
  • Strong collaboration with ML, data, platform engineers, data scientists, and product engineering teams, with the ability to lead projects and influence technical decisions.
  • Healthcare, regulated-data, or other high-stakes production ML experience is a plus but not required.
  • A desire to be a part of a high-performing, mission-driven team that operates with intense urgency, a strong sense of individual accountability, and a commitment to authentic feedback.

Technologies we use

Python, Kubernetes, AWS, Sagemaker, Terraform, S3, Snowflake, Airflow, Datadog

Skills

PythonKubernetesAWSSageMakerTerraformS3SnowflakeAirflowDatadogCI/CDFeature StoresModel RegistriesModel Serving

Similar roles

ML Engineering jobs
Scale AI

Tech Lead Manager- MLRE, ML Systems

Scale AISan Francisco, CA +2

Leads development and optimization of distributed frameworks for LLM post-training, training, and inference. Collaborates with ML teams to enable advanced model development and data curation, requiring expertise in large-scale ML systems and tools like PyTorch and CUDA.

252k – 315k/yr
On-siteML Engineering
Fireworks AI

MTS, Research Engineer

Fireworks AINew York, NY +1

Research Engineer conducting open-ended ML research, reproducing SOTA papers, building/scaling distributed training infrastructure on GPU clusters, and bridging research ideas into production code. Requires strong programming, ML frameworks, distributed systems experience, and math foundations; Master's/PhD preferred.

250k – 400k/yr
On-site7+ YOEML Engineering
Decagon

Senior Software Engineer, Agents

DecagonNew York, NY

Build and iterate on AI agents for customer interactions, outperforming humans in complex scenarios. Requires 5+ years experience with Python/TypeScript, systems debugging, and model evaluation/integration.

250k – 330k/yr
On-site5+ YOEML Engineering
Decagon

Senior Software Engineer, Agents

DecagonSan Francisco, CA

Build and deploy scalable AI agents for customer support that handle complex interactions across industries like finance and healthcare. Requires 5+ years experience with Python and TypeScript, focusing on system reliability and model integration.

250k – 330k/yr
On-site5+ YOEML Engineering
Sphere

Lead AI Engineer

SphereSan Francisco, CA

Leads development of proprietary AI reasoning model TRAM for interpreting global trade law, building data pipelines, fine-tuning LLMs, and evaluation frameworks for high-speed, accurate compliance determinations. Requires AI product experience, especially RAG systems and model fine-tuning.

250k – 280k/yr
On-siteML Engineering