# Senior Software Engineer - ML Services

**Company:** [AI Fund](https://hotfix.jobs/companies/ai-fund)
**Location:** Mountain View, CA
**Role:** ML Engineering
**Salary:** $190 – $220/hr
**Experience:** 5+ years
**Skills:** Kubernetes, Docker, AWS, GCP, Azure, PyTorch, vLLM, Agentic Coding Tools, Distributed Systems, Ml Platforms
**Posted:** 2026-05-07

> Designs, develops, and maintains high-performance ML services and agentic AI systems, collaborating with ML engineers to scale from prototype to production. Requires 5+ years backend/ML experience, cloud-native tech, and strong architecture skills.

## Job Description

## Key Responsibilities

- Be a driving force for the team's agentic coding practice - establishing patterns for spec-driven development, context engineering, and multi-agent orchestration that compound team output.
- Design, develop, and maintain AI-powered applications and services, focusing on high availability, performance, and reliability.
- Work closely with Machine Learning Engineers, building AI capabilities from early R&D prototyping to scalable operation in multiple production stacks.
- Build ML services designed for low-latency or high-throughput, and optimized for high cost efficiency.
- Lead cross-functional initiatives, collaborating with Machine Learning Engineers, Product Managers, and other teams to align technical solutions with business needs.
- Drive innovation by making strategic technical decisions, setting best practices, and mentoring engineers to elevate the team’s technical bar.
- Improve ML development process by enhancing the internal ML platform, facilitating data sourcing, and enabling ML observability for deployed services.

## Required Skills

- Fluency with agentic coding tools (Claude Code, Codex or equivalent). Experience writing effective specs, managing repo context, and reviewing/verifying agent output.
- **5+ years** of experience in software development, with a strong backend and ML engineering background.
- Experience working with cloud native technologies (**Docker**, **Kubernetes**).
- Experience working with cloud platforms (**AWS**, **GCP**, or **Azure**).
- Experience with building ML systems, from early prototype, to operating at scale in production.
- Strong software architecture skills, with experience designing and scaling distributed systems and cloud-based applications.
- Experience mentoring engineers and contributing to team-wide technical direction.
- Strong communication skills, with the ability to translate technical challenges into business impact.

## Nice to Have

- Experience with ML frameworks like **PyTorch**.
- Experience with serving ML models and LLMs using frameworks like **vLLM**.
- Experience with developer-facing products and building intuitive APIs.

## Similar roles

- [Senior Automation Specialist, AI Operations](https://hotfix.jobs/jobs/c96197f5-b0bd-4490-9530-ac8c381d9c8e) - Fetch - Remote - $75k – $85k/yr
- [Automation Lead, AI Operations](https://hotfix.jobs/jobs/7060e745-ee31-4b28-9ebe-8c503703bfd4) - Fetch - Remote - $97k – $114k/yr
- [Senior Software Engineer](https://hotfix.jobs/jobs/4c99a2b5-fd8f-4ff5-8406-933272a4dd44) - Astera - Emeryville, CA - $100k – $400k/yr
- [Sr. Applied AI Engineer](https://hotfix.jobs/jobs/7a6b5cc5-dc8a-485b-b536-5bfc45b42dcd) - Zapier - Remote - $102k – $287k/yr
- [Senior Software Engineer, AI](https://hotfix.jobs/jobs/f5373a65-e352-47d7-87cb-80e609ab7454) - Navan - New York, NY - $113k – $252k/yr

**Apply:** https://hotfix.jobs/jobs/96098cc4-d528-4287-9bd9-8f410ec52eac
**Canonical:** https://hotfix.jobs/jobs/96098cc4-d528-4287-9bd9-8f410ec52eac