Lead and mentor an MLOps team to build scalable ML infrastructure, automated pipelines, and low-latency model serving for large tabular models. Requires 7+ years MLOps experience including 3+ years leading teams, deep expertise in Kubernetes, model serving frameworks, and observability tools.
Salary not listed
Remote7+ YOEML Engineering
About the role
Key Responsibilities
Lead and mentor a team of MLOps engineers, fostering technical growth and a culture of operational excellence.
Define and drive the MLOps roadmap, aligning infrastructure capabilities with Research, Engineering and product objectives.
Establish best practices, standards, and processes for ML infrastructure, deployment, and operations.
Own technical decision-making for ML infrastructure architecture and tooling choices.
Architect and oversee scalable, automated machine learning pipelines, CI/CD workflows, and orchestration frameworks.
Drive the design and implementation of robust model serving infrastructure using platforms like Triton, TorchServe, TensorFlow Serving, and KServe.
Define inference architecture strategy optimized for ultra-low latency and high throughput.
Design and maintain feature stores, robust data pipelines, and scalable storage solutions to efficiently handle large volumes of data.
Collaborate with research teams to bridge the gap between experimentation and production.
Define logging, alerting, and monitoring strategy to track model performance, drift, and system reliability.
Requirements
Bachelor's or Master's degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
7+ years of experience in MLOps, with 3+ years in a technical leadership role.
Strong software engineering skills in Python, with experience in Bash and/or Go.
Proven track record of building and leading high-performing MLOps or infrastructure teams.
Experience building and designing MLOps infrastructure from the ground up.
Deep experience with MLOps platforms (MLflow, WandB, etc.) and frameworks (PyTorch, TensorFlow, etc.).
Deep experience with model serving frameworks (Triton, TorchServe, TensorFlow Serving, KServe) for high scalability and low latency inference.
Experience building and managing data pipelines to support both model training and inference.
Good experience with Kubernetes on a major cloud provider (AWS, GCP, or Azure) and with infrastructure as code (Terraform, Helm, GitOps).
Proficient with observability and monitoring tools (Prometheus, Grafana, Datadog, OpenTelemetry).
Excellent communication skills with ability to translate between research and production contexts.
Nice-to-Haves
Experience with workflow orchestration tools (Kubeflow, Airflow, Argo Workflows).
Experience with FastAPI and backend applications.
Familiarity with data platforms like Databricks or Snowflake.
Experience with LLM/foundation model serving and optimization.
Exposure to SRE practices or cloud security certifications.
Experience scaling ML infrastructure for AI startups.
Benefits
Competitive compensation with salary and equity.
Comprehensive health coverage for you and your dependents.
Paid parental leave for all new parents, inclusive of adoptive and surrogate journeys.
Relocation support for employees moving to join the team in one of our office locations.
A mission-driven, low-ego culture that values diversity of thought, ownership, and bias toward action.
Senior ML Engineer building observability, evaluation frameworks, and improvement loops for production agentic AI systems. Requires 5+ years production ML/LLM experience, strong grounding in agent design or evaluation, and hands-on work taking systems from prototype to scale.
216k – 270k
On-site5+ YOEML Engineering
Senior Software Engineer, Agent Oversight
Scale AISan Francisco, CA +1
Build platform infrastructure for observing, evaluating, and improving production AI agents at scale. Requires 4+ years software engineering experience with ML/LLM systems, strong backend/distributed systems skills, and collaboration with ML engineers.
216k – 270k
On-site5+ YOEML Engineering
Senior Software Engineer, AI Infrastructure
Ambient.aiRedwood City, CA
Build and optimize scalable AI infrastructure for real-time inference, evaluation, and continuous improvement of LLMs, LVMs, computer vision, and multimodal models on large-scale video data. Requires 4+ years production ML systems experience, strong Python skills, and expertise in inference optimization and model serving.
168k – 205k
Hybrid4+ YOEML Engineering
Senior Software Engineer
SpotOnChicago, IL +3
Senior AI Engineer building agentic workflows and orchestration layers to automate manual business processes for operations, sales, and customer support teams. Requires 7+ years software engineering experience, production LLM/agent expertise, and strong Python/TypeScript skills.
160k – 190k
Hybrid7+ YOEML Engineering
Senior AI Engineer, Enterprise
SnowflakeMenlo Park, CA
Senior AI Engineer building scalable backend services, distributed systems, and reusable AI platform components (agent frameworks, evaluation pipelines, SDKs) that power Snowflake's internal agentic applications for GTM teams. Requires 5+ years software engineering experience, strong Python/FastAPI skills, and production LLM experience.