# ML Ops Infrastructure Engineer

**Company:** [Deepgram](https://hotfix.jobs/companies/deepgram)
**Location:** Remote
**Role:** ML Engineering
**Salary:** $160k – $220k/yr
**Experience:** 4+ years
**Skills:** Python, CI/CD, Docker, Kubernetes, Ml Pipelines, Model Deployment, A/B Testing, Monitoring, Prometheus, Grafana, Terraform, Nvidia Triton, TensorRT, Onnx Runtime, Gpu Optimization
**Posted:** 2026-04-06

> Build and maintain ML infrastructure pipelines to deploy research models to production at scale, including CI/CD, A/B testing, monitoring, and optimization for low-latency voice AI serving. Requires 4+ years MLOps experience with Python, Docker, Kubernetes.

## Job Description

## What You'll Do
- Design and build CI/CD pipelines specifically tailored for ML model development, validation, and deployment
- Architect and maintain model deployment pipelines that move models from research environments through staging to production with confidence
- Build A/B testing infrastructure that enables controlled rollouts of new models and measures real-world performance impact
- Implement comprehensive monitoring for model performance in production -- accuracy metrics, latency, drift detection, and regression alerts
- Develop automated retraining pipelines that trigger on data changes, performance degradation, or scheduled cadences
- Create and maintain build and test environments that mirror production, giving researchers high-fidelity feedback before deployment
- Establish model versioning, artifact management, and rollback capabilities to ensure safe and reproducible deployments
- Collaborate with research engineers to define and enforce model quality gates before production promotion
- Build observability dashboards that give the team real-time insight into model health across all environments
- Optimize model serving infrastructure for latency, throughput, and cost efficiency

## Requirements
- 4+ years of experience in MLOps, DevOps, or infrastructure engineering with a focus on ML systems
- Strong proficiency in Python and experience building automation and tooling for ML workflows
- Deep experience with CI/CD systems and building pipelines for software and model delivery
- Hands-on experience with Docker and Kubernetes for containerized workload management
- Practical experience deploying and serving ML models in production environments
- Familiarity with model evaluation, validation, and quality assurance processes
- Understanding of monitoring and observability principles as applied to ML systems
- Strong problem-solving skills and a bias toward automation over manual processes

## Nice-to-Haves
- Experience with model serving frameworks such as NVIDIA Triton Inference Server, TensorRT, or ONNX Runtime
- Background in speech, audio, or real-time media ML systems
- Experience with Infrastructure as Code tools such as Terraform or Pulumi
- Hands-on experience with monitoring and observability stacks (Prometheus, Grafana, Datadog, or similar)
- Familiarity with GPU-accelerated inference optimization and profiling
- Experience with feature stores, data versioning, or ML metadata management
- Knowledge of canary deployment strategies and progressive delivery for ML models

## Similar roles

- [Research Scientist II](https://hotfix.jobs/jobs/4ac4da1a-a497-413d-b8fa-6b3b58cef7e1) - Pindrop - Remote - $160k – $185k/yr
- [AI Engineer - Database Engineering](https://hotfix.jobs/jobs/e2167614-4d69-4c69-bb69-40e1c6ba4571) - Snowflake - Menlo Park, CA - $160k – $230k/yr
- [Software Engineer, Cortex AI Infrastructure](https://hotfix.jobs/jobs/cfcfa4ed-3661-45be-8d97-71e231e17de7) - Snowflake - Menlo Park, CA - $160k – $225k/yr
- [ML Infrastructure Engineer](https://hotfix.jobs/jobs/ad8cfc6e-fc74-4f2a-ad7c-a2f5127c6461) - Mach9 - San Francisco, CA - $160k – $200k/yr
- [AI Engineer - Cortex Code Quality](https://hotfix.jobs/jobs/e685bc08-a554-4a85-89f2-f52919406431) - Snowflake - Menlo Park, CA - $160k – $230k/yr

**Apply:** https://hotfix.jobs/jobs/3e53824c-d6f1-4156-892e-cca11a6a394d
**Canonical:** https://hotfix.jobs/jobs/3e53824c-d6f1-4156-892e-cca11a6a394d