Machine Learning Engineer, Ops

What You’ll Do

• Design and maintain inference infrastructure for generative audio model architectures.
• Implement and manage high-performance inference engines.
• Orchestrate service deployments using Kubernetes (K8S), implementing advanced autoscaling paradigms to handle varying traffic loads efficiently.
• Develop and automate robust CI/CD pipelines to streamline the testing and deployment of model artifacts and inference configurations.
• Monitor production systems, establishing observability practices to track latency, resource utilization, and overall model performance.
• Collaborate closely with research teams to optimize model serving paths and evaluate various inference strategies.
• Optimize inference performance for both streaming and batch applications.

What You’ll Bring

• Deep understanding of modern audio model architectures (e.g., TTS, ASR) and their specific inference requirements.
• Strong hands-on experience with Kubernetes (K8S), container orchestration, and implementing autoscaling strategies for production workloads.
• Solid background in MLOps, including CI/CD automation and managing scalable cloud infrastructure.
• Proficiency in software engineering principles and experience with Python or Go for infrastructure tooling and backend services.
• Experience with GPU-accelerated inference and performance profiling techniques.
• Familiarity with high-performance inference engines (e.g., Triton Inference Server, vLLM-Omni) is a plus.

Compensation

The anticipated annual base salary range for this role is between $125,000-$165,000. When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for U.S.-based roles

• Competitive salary and generous company equity
• Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
• 42 days of paid time off, including: 15 PTO days, 10 sick days, 15 company holidays, 2 floating holidays
• Generous parental leave & fertility support
• 401(k) retirement savings plan
• Lifestyle spending account – $500/month to use however you’d like
• Complimentary lunch and snacks for in-office employees
• One Medical membership, and more!