# Lead Software Platform Engineer, MLOps

**Company:** [TetraScience](https://hotfix.jobs/companies/tetrascience)
**Location:** Remote
**Role:** ML Engineering
**Experience:** 10+ years
**Skills:** TypeScript, Python, databricks mlflow, aws bedrock, AWS, Docker, CloudFormation, aws cdk, REST APIs, openapi, RAG, mcp, distributed tracing, CI/CD, model serving
**Posted:** 2026-08-04

> Leads the architecture and operation of a multi-tenant AI/ML platform supporting production models, LLMs, and agents in regulated scientific environments. Requires 10+ years in distributed cloud-native systems, strong TypeScript and Python skills, production LLM/RAG experience, and technical leadership.

## Job Description

## Responsibilities
- Own the technical architecture of the AI/ML platform and the service and API surface used to run models and agents against scientific data.
- Own the end-to-end model and prompt lifecycle across Databricks MLflow and AWS Bedrock, including registration, versioning, asset bundles, staged promotion, rollback, and multi-model serving.
- Design inference infrastructure for real-time and batch workloads, including routing, batching, caching, concurrency control, GPU and accelerator capacity planning, large binary inputs, and graceful degradation.
- Integrate AI models and LLMs into production systems using retrieval-augmented generation (RAG), tool and function calling, MCP-based tooling, and agent runtimes.
- Design security controls for guardrails, prompt-injection and tool-abuse defenses, PII and PHI handling, and tenant data boundaries.
- Build evaluation and quality infrastructure, including offline and online evaluation harnesses, golden datasets, CI regression gates, A/B and shadow deployments, and drift and hallucination detection.
- Establish monitoring, alerting, logging, and distributed tracing, and define SLI, SLO, and SLA practices for probabilistic systems.
- Design reproducibility and lineage for validated environments through versioned data, code, prompts, and model artifacts and auditable trails.
- Contribute to infrastructure-as-code and deployment automation using CloudFormation and AWS CDK, including multi-tenant infrastructure, online upgrades, and on-demand compute allocation.
- Own production readiness, performance, reliability, cost efficiency, incident response, and runbooks for the AI platform.
- Lead design reviews, write reference architectures and technical documentation, mentor engineers, and evaluate emerging AI infrastructure and build-versus-buy decisions.

## Requirements
- 10+ years of professional experience in software and infrastructure engineering, designing, building, and scaling distributed cloud-native systems in production.
- Experience as a technical leader or architect accountable for system design, scalability, performance, and cost optimization.
- Experience designing security into multi-tenant platforms, including tenant authorization boundaries, PII and PHI handling, prompt injection, and tool-abuse risks.
- Extensive experience building and maintaining production AI/ML infrastructure as a multi-tenant product for external users.
- Hands-on experience taking LLM systems to production, including RAG, retrieval and embedding design, prompt and model versioning, and tool or function calling.
- Expert coding skills in TypeScript and Python for robust APIs and backend services.
- Production experience with model registries and serving stacks, ideally Databricks MLflow.
- Experience using AI evaluation as a release gate, including evaluation harnesses, regression gates, and drift or quality monitoring.
- Proficiency in API-first design, REST, and OpenAPI.
- Working knowledge of AWS and Docker, plus infrastructure-as-code such as CloudFormation or AWS CDK.
- Experience with CI/CD pipelines, deployment automation, monitoring, alerting, distributed tracing, and SLI/SLO/SLA practices.
- Strong communication, cross-functional influence, technical direction, and mentoring skills.

## Similar roles

- [Senior Machine Learning Engineer, Price Modeling](https://hotfix.jobs/jobs/ebda518f-cc52-48e2-a526-6c814f4334b3) - Airbnb - Remote - $196k – $227k/yr
- [Senior Software Engineer, Autonomy Capabilities - Space](https://hotfix.jobs/jobs/9cca1cd3-4d50-4638-95c5-233aa6fc65a5) - Shield AI - Boston, MA - $160k – $240k/yr
- [Senior Manager, Machine Learning Engineering-Applied Research](https://hotfix.jobs/jobs/c1fa1d53-0f95-41ef-a92d-f0aca67444ca) - Pinterest - Remote - $228k – $469k/yr
- [Senior AI Engineer, Agentic Data Enrichment](https://hotfix.jobs/jobs/cd9cf504-6eed-41f6-95fe-6dd1b17fd649) - Baselayer - San Francisco, CA - $230k – $340k/yr
- [Senior Machine Learning Engineer](https://hotfix.jobs/jobs/bb887dd9-d892-4716-9554-22f5c5b3a0b5) - Airbnb - Remote - $196k – $227k/yr

**Apply:** https://hotfix.jobs/jobs/16f5892f-2ec3-431e-afd3-9f137718589b
**Canonical:** https://hotfix.jobs/jobs/16f5892f-2ec3-431e-afd3-9f137718589b