# Software Engineer, AI Platform

**Company:** [Mixpanel](https://hotfix.jobs/companies/mixpanel)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $188k – $254k/yr
**Experience:** 2+ years
**Skills:** LLMs, AI Agents, Python, JavaScript, Microservices, APIs, MLOps, vector search, Prompt Engineering, Evaluation Frameworks, distributed tracing, Observability
**Posted:** 2026-07-28

> Build scalable AI platform infrastructure including agent orchestration frameworks, evaluation systems, and high-performance serving layers to accelerate AI development and deployment at Mixpanel and for customers. Requires 2+ years software engineering experience with hands-on LLM/agent integration and full-stack fundamentals.

## Job Description

## Responsibilities
- Design and develop core backend services, APIs, and microservices that enable product teams to easily and securely leverage AI models.
- Build scalable frameworks and tools to support multi-step agent workflows, including task decomposition, tool invocation, and persistent memory.
- Build robust evaluation systems to continuously measure reasoning quality, hallucination rates, and task success.
- Architect high-performance serving infrastructure with strict guarantees around latency, throughput, cost-efficiency, and error handling.
- Ensure comprehensive monitoring, structured logging, and distributed tracing across all deployed AI models.
- Partner with designers, product managers, and other engineers to build self-serve infrastructure that transforms our AI development cycle.
- Advocate for software engineering best practices, conduct thorough design and code reviews, and mentor junior engineers.

## Requirements
- Bachelor's degree in Computer Science, Mathematics, a related field, or equivalent practical experience.
- 2+ years of professional software engineering experience.
- Strong full-stack fundamentals: comfortable working across frontend, backend, and data layers.
- Excellent debugging and technical investigation skills.
- Strong technical communication, ideally with experience collaborating in an asynchronous remote environment.
- Ability to move fast and iterate in ambiguous environments: take ownership and focus on delivering value to users.
- Hands-on experience integrating and orchestrating LLMs and agents.
- Experience building AI native systems, including iteratively improving and scaling them in production.
- Familiarity with techniques used to optimize AI agents: eval frameworks, agent tooling, vector search engines, context engineering, and prompt engineering.
- A desire to be on the forefront of leveraging AI to drive product improvement, observability and product analytics at scale.

## Compensation and Benefits
**Total Target Cash Compensation (TTCC):** $188,000–$254,000 USD (includes base and variable compensation; benchmarked to SF Bay Area).

**Benefits:**
- Comprehensive Medical, Vision, and Dental Care
- Mental Wellness Benefit
- Generous Vacation Policy & Additional Company Holidays
- Enhanced Parental Leave
- Volunteer Time Off
- Pre-Tax Benefits including 401(K), Wellness Benefit, Holiday Break
- Equity consideration

## Similar roles

- [Software Engineer, ML Platform](https://hotfix.jobs/jobs/ecb0904e-a0cc-4205-bce7-00148248462c) - Zoox - Foster City, CA - $182k – $257k/yr
- [Environment Engineers](https://hotfix.jobs/jobs/95ac0613-5ae8-4b75-b3d0-139d6eca0eb6) - AfterQuery - San Francisco, CA - $180k – $220k/yr
- [Forward-Deployed Engineer (CoE)](https://hotfix.jobs/jobs/9475b7fa-0d49-403f-b9dd-ef5750183509) - Tessera Labs - New York, NY - $180k – $233k/yr
- [Forward Deployed ML Engineer](https://hotfix.jobs/jobs/9213e459-6ba5-4b86-9bf1-0251688c4720) - Modal - New York, NY - $180k – $250k/yr
- [Research Engineer](https://hotfix.jobs/jobs/c2a68b87-40ce-47b1-9d08-0a812c2ac5f2) - Decagon - San Francisco, CA - $200k – $400k/yr

**Apply:** https://hotfix.jobs/jobs/590aeabe-3c16-457b-a738-a6c4b0e5c477
**Canonical:** https://hotfix.jobs/jobs/590aeabe-3c16-457b-a738-a6c4b0e5c477