Skip to content
MixpanelMixpanelSan Francisco, CA

Senior Software Engineer, AI Platform

Senior Software Engineer building scalable AI infrastructure, agent orchestration frameworks, evaluation systems, and high-performance LLM serving at Mixpanel. Requires 5+ years experience and hands-on LLM/agent work.

226k – 306k
Hybrid5+ YOEML Engineering

About the role

Responsibilities

  • Design and develop the core backend services, APIs, and microservices that enable product teams to easily and securely leverage AI models.
  • Build scalable frameworks and tools to support multi-step agent workflows, including task decomposition, tool invocation, and persistent memory.
  • Build robust evaluation systems to continuously measure reasoning quality, hallucination rates, and task success.
  • Architect high-performance serving infrastructure with strict guarantees around latency, throughput, cost-efficiency, and error handling.
  • Ensure comprehensive monitoring, structured logging, and distributed tracing across all deployed AI models.
  • Partner with designers, product managers, and other engineers to build self-serve infrastructure that transforms our AI development cycle.
  • Advocate for software engineering best practices, conduct thorough design and code reviews, and mentor junior engineers.

Requirements

  • Bachelor's degree in Computer Science, Mathematics, a related field, or equivalent practical experience
  • 5+ years of professional software engineering experience
  • Strong full-stack fundamentals: comfortable working across frontend, backend, and data layers
  • Excellent debugging and technical investigation skills
  • Strong technical communication, ideally with experience collaborating in an asynchronous remote environment
  • Ability to move fast and iterate in ambiguous environments: take ownership and focus on delivering value to users
  • Hands-on experience integrating and orchestrating LLMs and agents
  • Experience building AI native systems, including iteratively improving and scaling them in production
  • Familiarity with techniques used to optimize AI agents: eval frameworks, agent tooling, vector search engines, context engineering, and prompt engineering
  • A desire to be on the forefront of leveraging AI to drive product improvement, observability and product analytics at scale

Compensation & Benefits

  • Total target cash compensation (TTCC): $226,000–$306,000 USD (includes base + variable)
  • Eligible for equity
  • Comprehensive Medical, Vision, and Dental Care
  • Mental Wellness Benefit
  • Generous Vacation Policy & Additional Company Holidays
  • Enhanced Parental Leave
  • Volunteer Time Off
  • Pre-Tax Benefits including 401(K), Wellness Benefit, Holiday Break

Skills

PythonJavaScriptLLMsAgent OrchestrationVector SearchPrompt EngineeringMLOpsBackend DevelopmentFrontend DevelopmentDistributed Systems

Similar roles

ML Engineering jobs
Furtherai

Senior AI Engineer

FurtheraiSan Francisco, CA

Build and optimize AI agent orchestration and reasoning systems for the insurance industry. Requires 6+ years in ML/AI, strong Python skills, and exceptional LLM prompting ability.

225k – 325k
On-site6+ YOEML Engineering
The Voleon Group

Senior Research Engineer - Voleon Securities

The Voleon GroupNew York, NY +1

Builds and optimizes ML research infrastructure, deploys models to production for market-making strategies, and mentors engineers. Requires 5+ years backend experience, Python proficiency, and ML frameworks like PyTorch/Jax.

225k – 310k
Hybrid5+ YOEML Engineering
Luminate

Senior Data Scientist, Generative AI

LuminateNew York, NY

Develops and deploys scalable generative AI/ML models for entertainment data products, owning end-to-end lifecycle from data sourcing to production monitoring. Requires 5+ years experience, MS/PhD, deep LLM expertise, Python/PyTorch proficiency, and AWS deployment skills.

225k – 240k
Hybrid5+ YOEML Engineering
Retell AI

Senior Machine Learning Engineer

Retell AIRedwood City, CA

Builds and deploys production ML models for real-time voice AI agents, fine-tuning LLMs and audio models, running benchmarks and human evaluations, and maintaining ML infrastructure for high-scale performance.

225k – 325k
On-siteML Engineering
Twilio

Tech Lead, Applied Research

TwilioUnited States

Tech Lead driving AI R&D and end-to-end delivery of production-ready prototypes using full-stack development, LLMs, and emerging technologies. Requires 10+ years experience and strong autonomy.

228k – 335k
Remote10+ YOEML Engineering