# Senior ML Ops Engineer

**Company:** [Confido Legal](https://hotfix.jobs/companies/confido-legal)
**Location:** New York, NY
**Role:** ML Engineering
**Salary:** $210k – $300k/yr
**Experience:** 5+ years
**Skills:** MLOps, Python, AWS, Terraform, Kubernetes, MLflow, Bentoml, Ray, Airflow, Snowflake, Kafka, vLLM, Onnx, TensorRT, SageMaker
**Posted:** 2026-07-06

> Be the first dedicated owner of Confido's ML platform, owning end-to-end ML pipelines, infrastructure for training/inference/agentic workloads, and providing reproducible environments for the AI/ML team in a fast-growing CPG AI startup.

## Job Description

## What you'll do
- Own ML pipelines end to end — experimentation to production — and the infrastructure behind training, inference, and agentic workloads
- Give the AI/ML team a paved road: reproducible environments and fast paths from prototype to production, so they can try new models and agents without fighting the infra
- Stand up the cloud foundation as Infrastructure as Code and the CI/CD that ships ML safely
- Serve and optimize inference and forecasting workloads — latency, throughput, and cost — and the data streams feeding them (e.g. turning a heavy synchronous model call into an async, parallelized one)
- Own the data interface with data engineering: serve the right data to models and agents, and write their outputs back into the platform's data systems for the rest of Confido to use
- Make reliability, observability, security, and privacy the default — and keep model and agent quality measurable in production through online evals and human-in-the-loop review, not just uptime

## Requirements
- 5+ years in MLOps, ML platform, AI infrastructure, or platform engineering — on production ML systems, not pipelines on paper
- Live at the seam of software and infrastructure: equally at home writing production code and standing up cloud infra
- Driven a real pipeline end to end and can walk through it: the architecture, the security and cost trade-offs, and what you'd change
- Deep cloud infrastructure understanding, distributed data systems, and IaC — you can boot an environment from scratch, wire CI/CD, and run containerized workloads in production without hand-holding
- Strong Python and comfort in a production app codebase (Ruby, Java)
- Monitoring, security, and cost are instincts, not afterthoughts
- High ownership in a fast-moving startup, and experience productionizing what research/AI teams build

## Nice to have
- LLMOps tooling — tracing, prompt/version management, eval harnesses
- Inference optimization (vLLM, ONNX, TensorRT) and GPU / spot-instance economics
- ML platform and orchestration tooling (MLflow, BentoML, Ray, Airflow)
- Large-scale data systems (Snowflake, Kafka) and vector databases
- Managed ML services (Bedrock, SageMaker, Vertex AI)
- Multimodal or generative AI in production

## Stack
Python · Ruby/Rails · AWS · Terraform · Kubernetes · GitHub Actions · Snowflake · Aurora/RDS · Redis · Kafka

## Perks + Benefits
- Equity — own a piece of what you're building
- Fully paid health coverage with Aetna (we cover 100% of premiums)
- Top-tier dental and vision through Guardian
- 12 weeks paid parental leave
- Unlimited PTO, plus regular 4-day holiday weekends we actually take
- 401(k) through Vestwell
- Paid relocation — we'll get you here
- Full desk setup on day one (laptop, monitor, keyboard) + a $200 stipend to make it yours
- Catered Friday lunches, team dinners on us, and unlimited coffee + snacks featuring our own brands

## Similar roles

- [Senior ML / AI Engineer](https://hotfix.jobs/jobs/c311e91e-9e1b-439f-a358-a9c2c6c271eb) - Confido Legal - New York, NY - $210k – $280k/yr
- [Senior Machine Learning Engineer - Perception Detection and Tracking](https://hotfix.jobs/jobs/a12967e6-27c9-441e-bc1c-9b70d7890919) - Zoox - Foster City, CA - $214k – $290k/yr
- [Senior Machine Learning Engineer, Agent Oversight](https://hotfix.jobs/jobs/1f504a69-044f-47ab-872b-120a1706cd88) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, Agent Oversight](https://hotfix.jobs/jobs/808ce719-6b16-4b6e-8887-8c8f8a780b75) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, GenAI](https://hotfix.jobs/jobs/6d053d42-17b4-4864-a766-f0cf913200b3) - Scale AI - San Francisco, CA - $216k – $270k/yr

**Apply:** https://hotfix.jobs/jobs/5a3e3404-63c2-46da-b5c1-a727f2272b7f
**Canonical:** https://hotfix.jobs/jobs/5a3e3404-63c2-46da-b5c1-a727f2272b7f