Skip to content
ShippoShippoUnited States

Principal Machine Learning Engineer, ML Platform

Principal ML Platform Engineer builds production ML infrastructure for shipping logistics ML (prediction, fraud, optimization). Requires 15+ years engineering, 4+ years ML production systems, Kubernetes/MLflow expertise.

212k – 287k/yr
Remote15+ YOEML Engineering

About the role

Responsibilities

  • Set technical strategy and multi-quarter roadmap for ML platform.
  • Own cross-team architecture, RFCs, and design reviews.
  • Build core components: ML lifecycle (MLflow), training pipelines, Kubernetes model serving, batch inference, observability, and developer experience.
  • Evaluate inference frameworks, resolve performance bottlenecks, establish standards.
  • Partner with Data Science and Engineering teams; mentor engineers.

Requirements

  • 15+ years software engineering with production systems ownership.
  • 4+ years end-to-end ML systems in production (on-call, architecture).
  • Strong Kubernetes experience (deployments, autoscaling, observability).
  • Hands-on with MLflow or equivalent.
  • Expertise in inference tradeoffs, reliability (SLOs), Principal-level leadership.
  • Experience with managed ML platforms (Databricks, SageMaker, Vertex AI).

Nice-to-Haves

  • Databricks experience.
  • Inference/serving frameworks.
  • Feature stores, optimization systems, LLM workflows.

Compensation

Base salary: $212,000 - $287,000 USD (midpoint $250,000), plus equity and benefits.

Skills

MLflowKubernetesDatabricksMl PlatformModel ServingInference FrameworksObservabilityCI/CDSageMakerVertex Ai

Similar roles

ML Engineering jobs
Formation Bio

Principal Data Scientist, Medical Imaging

Formation BioNew York, NY +1

Lead development of deep learning models for medical image analysis (MRI, X-ray) to accelerate clinical trials, create AI biomarkers, and integrate imaging AI into drug development workflows. Requires PhD and 5+ years building production-grade medical imaging AI.

205k – 267k/yr
Hybrid5+ YOEML Engineering
Upstart

Principal Machine Learning Engineer

UpstartUnited States

Leads engineering initiatives to build scalable ML platform infrastructure, including unified embeddings, feature pipelines, and continuous learning systems. Requires 7+ years in applied ML, Python/ML frameworks expertise, and Master's/PhD in quantitative field.

221k – 300k/yr
Remote7+ YOEML Engineering
Astera

Principal Software Engineer, Neuroscience Platforms

AsteraEmeryville, CA

Lead development of computational infrastructure for large-scale neuroscience research, building real-time stimulus/acquisition systems, high-throughput data pipelines, and cloud tools. Requires exceptional full-stack engineering with real-time systems experience; neuroscience background not required.

200k – 350k/yr
On-site7+ YOEML Engineering
Everlaw

Staff/Principal AI Engineer

EverlawOakland, CA

Leads design and execution of AI strategy for legal discovery platform, guiding engineering teams on LLMs, NLP, and frontier models at massive scale. Requires 6+ years ML/AI experience and 10+ years software engineering.

228k – 340k/yr
Hybrid6+ YOEML Engineering
Armis

Principal Machine Learning Engineer

ArmisUnited States

Build and optimize AI/ML pipelines for data processing, model training, and deployment. Collaborate with data scientists to implement scalable AI solutions on cloud infrastructure.

184k – 250k/yr
Remote7+ YOEML Engineering