Skip to content
MixpanelMixpanelSan Francisco, CA

Software Engineer, AI Platform

Build scalable AI platform infrastructure including agent orchestration frameworks, evaluation systems, and high-performance serving layers to accelerate AI development and deployment at Mixpanel and for customers. Requires 2+ years software engineering experience with hands-on LLM/agent integration and full-stack fundamentals.

188k – 254k/yr
Hybrid2+ YOEML Engineering

About the role

Responsibilities

  • Design and develop core backend services, APIs, and microservices that enable product teams to easily and securely leverage AI models.
  • Build scalable frameworks and tools to support multi-step agent workflows, including task decomposition, tool invocation, and persistent memory.
  • Build robust evaluation systems to continuously measure reasoning quality, hallucination rates, and task success.
  • Architect high-performance serving infrastructure with strict guarantees around latency, throughput, cost-efficiency, and error handling.
  • Ensure comprehensive monitoring, structured logging, and distributed tracing across all deployed AI models.
  • Partner with designers, product managers, and other engineers to build self-serve infrastructure that transforms our AI development cycle.
  • Advocate for software engineering best practices, conduct thorough design and code reviews, and mentor junior engineers.

Requirements

  • Bachelor's degree in Computer Science, Mathematics, a related field, or equivalent practical experience.
  • 2+ years of professional software engineering experience.
  • Strong full-stack fundamentals: comfortable working across frontend, backend, and data layers.
  • Excellent debugging and technical investigation skills.
  • Strong technical communication, ideally with experience collaborating in an asynchronous remote environment.
  • Ability to move fast and iterate in ambiguous environments: take ownership and focus on delivering value to users.
  • Hands-on experience integrating and orchestrating LLMs and agents.
  • Experience building AI native systems, including iteratively improving and scaling them in production.
  • Familiarity with techniques used to optimize AI agents: eval frameworks, agent tooling, vector search engines, context engineering, and prompt engineering.
  • A desire to be on the forefront of leveraging AI to drive product improvement, observability and product analytics at scale.

Compensation and Benefits

Total Target Cash Compensation (TTCC): $188,000–$254,000 USD (includes base and variable compensation; benchmarked to SF Bay Area).

Benefits:

  • Comprehensive Medical, Vision, and Dental Care
  • Mental Wellness Benefit
  • Generous Vacation Policy & Additional Company Holidays
  • Enhanced Parental Leave
  • Volunteer Time Off
  • Pre-Tax Benefits including 401(K), Wellness Benefit, Holiday Break
  • Equity consideration

Skills

LLMsAI AgentsPythonJavaScriptMicroservicesAPIsMLOpsvector searchPrompt EngineeringEvaluation Frameworksdistributed tracingObservability

Similar roles

ML Engineering jobs
Zoox

Software Engineer, ML Platform

ZooxFoster City, CA

Build and operate scalable ML training frameworks, distributed infrastructure, and model lifecycle tools to power foundational models, reinforcement learning, and other ML use cases across Zoox's autonomous driving teams. Requires 2+ years ML infrastructure experience with PyTorch, DeepSpeed, JAX, Ray and AWS.

182k – 257k/yrHybrid2+ YOEML Engineering
AfterQuery

Environment Engineers

AfterQuerySan Francisco, CA

Designs datasets, evaluation rubrics, and reward signals for RLHF/RLVR pipelines to expose model failure modes and improve frontier AI capabilities. Partners with AI labs; requires 1-4 YOE and passion for data-driven model behavior.

180k – 220k/yrOn-site1+ YOEML Engineering
Tessera Labs

Forward-Deployed Engineer (CoE)

Tessera LabsNew York, NY

Leads end-to-end delivery of multi-agent AI systems for enterprise clients, analyzing workflows, building Python-based integrations with systems like SAP and Salesforce, and ensuring production deployment. Requires 1-3 years experience in data science or solutions engineering, Python proficiency, and strong communication skills.

180k – 233k/yrHybrid1+ YOEML Engineering
Modal

Forward Deployed ML Engineer

ModalNew York, NY +1

Partners with sales to drive technical sales of AI/ML infrastructure, leading demos, POCs, and solutions for enterprise customers. Requires 2+ years software engineering, AI/ML expertise, and strong communication skills.

180k – 250k/yrOn-site2+ YOEML Engineering
Decagon

Research Engineer

DecagonSan Francisco, CA +1

Research Engineer building and deploying production conversational AI models and agents at Decagon. Improve instruction following, retrieval, memory, and long-horizon task completion; take research prototypes to measurable production impact using LLMs and ML tooling.

200k – 400k/yrOn-site2+ YOEML Engineering