# Senior Software Engineer, AI Platform

**Company:** [Mixpanel](https://hotfix.jobs/companies/mixpanel)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $226k – $306k/yr
**Experience:** 5+ years
**Skills:** Python, JavaScript, LLMs, Agent Orchestration, Vector Search, Prompt Engineering, MLOps, Backend Development, Frontend Development, Distributed Systems
**Posted:** 2026-06-23

> Senior Software Engineer building scalable AI infrastructure, agent orchestration frameworks, evaluation systems, and high-performance LLM serving at Mixpanel. Requires 5+ years experience and hands-on LLM/agent work.

## Job Description

## Responsibilities
- Design and develop the core backend services, APIs, and microservices that enable product teams to easily and securely leverage AI models.
- Build scalable frameworks and tools to support multi-step agent workflows, including task decomposition, tool invocation, and persistent memory.
- Build robust evaluation systems to continuously measure reasoning quality, hallucination rates, and task success.
- Architect high-performance serving infrastructure with strict guarantees around latency, throughput, cost-efficiency, and error handling.
- Ensure comprehensive monitoring, structured logging, and distributed tracing across all deployed AI models.
- Partner with designers, product managers, and other engineers to build self-serve infrastructure that transforms our AI development cycle.
- Advocate for software engineering best practices, conduct thorough design and code reviews, and mentor junior engineers.

## Requirements
- Bachelor's degree in Computer Science, Mathematics, a related field, or equivalent practical experience
- 5+ years of professional software engineering experience
- Strong full-stack fundamentals: comfortable working across frontend, backend, and data layers
- Excellent debugging and technical investigation skills
- Strong technical communication, ideally with experience collaborating in an asynchronous remote environment
- Ability to move fast and iterate in ambiguous environments: take ownership and focus on delivering value to users
- Hands-on experience integrating and orchestrating LLMs and agents
- Experience building AI native systems, including iteratively improving and scaling them in production
- Familiarity with techniques used to optimize AI agents: eval frameworks, agent tooling, vector search engines, context engineering, and prompt engineering
- A desire to be on the forefront of leveraging AI to drive product improvement, observability and product analytics at scale

## Compensation & Benefits
- Total target cash compensation (TTCC): $226,000–$306,000 USD (includes base + variable)
- Eligible for equity
- Comprehensive Medical, Vision, and Dental Care
- Mental Wellness Benefit
- Generous Vacation Policy & Additional Company Holidays
- Enhanced Parental Leave
- Volunteer Time Off
- Pre-Tax Benefits including 401(K), Wellness Benefit, Holiday Break

## Similar roles

- [Senior AI Engineer](https://hotfix.jobs/jobs/82f1b538-fd7d-4589-983c-6fa338cf0956) - Furtherai - San Francisco, CA - $225k – $325k/yr
- [Senior Research Engineer - Voleon Securities](https://hotfix.jobs/jobs/05c378f2-b1c9-4bcd-a137-172aeb24301d) - The Voleon Group - New York, NY - $225k – $310k/yr
- [Senior Data Scientist, Generative AI](https://hotfix.jobs/jobs/9ad20a87-5b39-4810-a68e-250e59d0ff54) - Luminate - New York, NY - $225k – $240k/yr
- [Senior Machine Learning Engineer](https://hotfix.jobs/jobs/befa3407-396c-45b7-a9bd-66af0cd58088) - Retell AI - Redwood City, CA - $225k – $325k/yr
- [Tech Lead, Applied Research](https://hotfix.jobs/jobs/d55cf908-ba33-4d24-9a25-d2b4b0ead042) - Twilio - Remote - $228k – $335k/yr

**Apply:** https://hotfix.jobs/jobs/0e5958d6-2973-4ede-932f-409268e3e080
**Canonical:** https://hotfix.jobs/jobs/0e5958d6-2973-4ede-932f-409268e3e080