Skip to content
MercuryMercurySan Francisco, CA

Senior Machine Learning Operations Engineer

Build and operate Mercury's real-time ML inference platform for fraud risk decisioning. Own model deployment, observability, and lifecycle tooling with strong backend Python fundamentals.

167k – 208k/yr
Hybrid5+ YOEML Engineering

About the role

Responsibilities

  • Build and operate the real-time inference service that scores models for the risk decision engine, with low latency and high availability as first-class requirements
  • Own model deployment infrastructure — registry and versioning, CI/CD with performance, bias, and consistency checks, shadow mode, and staged rollouts
  • Build model observability: availability, latency, and error monitoring, plus drift detection as a retraining trigger
  • Partner with Risk Data Science to take models from a clean development-to-production handoff through to production operation under MLP ownership
  • Implement experimentation capabilities such as champion/challenger and canary routing, and explainability outputs like SHAP attributions
  • Feel a strong sense of product ownership and actively seek responsibility — self-organize on small and medium projects, and help shape and build a brand-new platform team

Requirements

  • 5+ years in machine learning engineering, backend software engineering, MLOps, or a closely related field
  • Production ML service experience — deploying, serving, and operating models in low-latency, high-availability contexts
  • Strong backend engineering fundamentals in Python, with API frameworks like FastAPI or Flask
  • Experience with model deployment and lifecycle tooling: model registries, CI/CD for models, versioning, and staged rollout patterns (shadow, canary, champion/challenger)
  • Experience building observability and alerting for production services — latency, errors, and ideally model-specific signals like drift
  • Comfort with the data layer ML depends on: SQL, key-value/low-latency stores (Redis, DynamoDB, or equivalent), and streaming pipelines (Kafka, Kinesis, Redpanda, or equivalent)

Nice to Have

  • Familiarity with a modern data stack (Snowflake, dbt, Dagster, Airflow, or similar)
  • Experience operating in a regulated, audit-sensitive, or compliance-adjacent environment
  • Exposure to functional languages or willingness to work across a stack that includes Haskell, React, and TypeScript

Skills

PythonFastAPIFlaskSQLRedisDynamoDBKafkaKinesisRedpandaModel RegistriesCI/CDObservabilityDrift DetectionShap

Similar roles

ML Engineering jobs
Drata

Senior Applied Research Engineer

DrataSan Francisco, CA

Senior Applied Research Engineer driving AI system quality through experimentation and evaluation of RAG, retrieval, and reasoning systems. Requires 5+ years applied ML/NLP experience with strong Python and evaluation methodology skills.

167k – 226k/yr
Hybrid5+ YOEML Engineering
Drata

Senior AI Engineer, Agent Harness

DrataSan Francisco, CA

Senior AI Engineer to design, build, and scale agentic AI systems using LLMs for compliance automation. Own end-to-end development of production LLM + retrieval + agent workflows with focus on responsible AI.

167k – 226k/yr
Hybrid5+ YOEML Engineering
Databricks

Senior Software Engineer, Model Serving

DatabricksSan Francisco, CA

Designs and builds scalable infrastructure for high-throughput, low-latency AI/ML model serving on CPU/GPU. Requires 5+ years in distributed systems, inference expertise, and strong system design skills.

166k – 225k/yr
On-site5+ YOEML Engineering
Databricks

Senior Machine Learning Engineer - GenAI Platform

DatabricksSan Francisco, CA

Build customer-facing generative AI platform covering ML lifecycle from data generation to agent-building. Requires 4+ years experience in distributed systems and ML platforms, with strong product ownership.

166k – 225k/yr
On-site4+ YOEML Engineering
Ambient.ai

Senior Software Engineer, AI Infrastructure

Ambient.aiRedwood City, CA

Build and optimize scalable AI infrastructure for real-time inference, evaluation, and continuous improvement of LLMs, LVMs, computer vision, and multimodal models on large-scale video data. Requires 4+ years production ML systems experience, strong Python skills, and expertise in inference optimization and model serving.

168k – 205k/yr
Hybrid4+ YOEML Engineering