Skip to content

Senior Software Engineer, AI Platform

226k – 306kSan Francisco, CAML EngineeringHybrid5+ YOE
Summary

Senior Software Engineer building scalable AI infrastructure, agent orchestration frameworks, evaluation systems, and high-performance LLM serving at Mixpanel. Requires 5+ years experience and hands-on LLM/agent work.

About the role

Responsibilities

  • Design and develop the core backend services, APIs, and microservices that enable product teams to easily and securely leverage AI models.
  • Build scalable frameworks and tools to support multi-step agent workflows, including task decomposition, tool invocation, and persistent memory.
  • Build robust evaluation systems to continuously measure reasoning quality, hallucination rates, and task success.
  • Architect high-performance serving infrastructure with strict guarantees around latency, throughput, cost-efficiency, and error handling.
  • Ensure comprehensive monitoring, structured logging, and distributed tracing across all deployed AI models.
  • Partner with designers, product managers, and other engineers to build self-serve infrastructure that transforms our AI development cycle.
  • Advocate for software engineering best practices, conduct thorough design and code reviews, and mentor junior engineers.

Requirements

  • Bachelor's degree in Computer Science, Mathematics, a related field, or equivalent practical experience
  • 5+ years of professional software engineering experience
  • Strong full-stack fundamentals: comfortable working across frontend, backend, and data layers
  • Excellent debugging and technical investigation skills
  • Strong technical communication, ideally with experience collaborating in an asynchronous remote environment
  • Ability to move fast and iterate in ambiguous environments: take ownership and focus on delivering value to users
  • Hands-on experience integrating and orchestrating LLMs and agents
  • Experience building AI native systems, including iteratively improving and scaling them in production
  • Familiarity with techniques used to optimize AI agents: eval frameworks, agent tooling, vector search engines, context engineering, and prompt engineering
  • A desire to be on the forefront of leveraging AI to drive product improvement, observability and product analytics at scale

Compensation & Benefits

  • Total target cash compensation (TTCC): $226,000–$306,000 USD (includes base + variable)
  • Eligible for equity
  • Comprehensive Medical, Vision, and Dental Care
  • Mental Wellness Benefit
  • Generous Vacation Policy & Additional Company Holidays
  • Enhanced Parental Leave
  • Volunteer Time Off
  • Pre-Tax Benefits including 401(K), Wellness Benefit, Holiday Break
Skills
PythonJavaScriptLLMsAgent OrchestrationVector SearchPrompt EngineeringMLOpsBackend DevelopmentFrontend DevelopmentDistributed Systems
Similar roles at this salary range
All ML Engineering jobs →
Airbnb

Staff Machine Learning Engineer

Build and deploy cutting-edge ML and Generative AI systems to transform Airbnb's customer support experience, focusing on LLM fine-tuning, RAG, and intelligent service automation.

212k – 260kSan Francisco, CAML EngineeringRemote9+ YOELLMRAG
Twilio

Tech Lead, Applied Research

Tech Lead driving AI R&D and end-to-end delivery of production-ready prototypes using full-stack development, LLMs, and emerging technologies. Requires 10+ years experience and strong autonomy.

228k – 335kUnited StatesML EngineeringRemote10+ YOEGoSQL
Reddit

Senior Machine Learning Systems Engineer

Build large-scale ML experimentation and training orchestration platforms, including agentic AI execution systems, to accelerate Ads ML development at Reddit. Requires 5+ years infrastructure experience and 2+ years building production ML platforms.

217k – 303kUnited StatesML EngineeringRemote5+ YOERayArgo
Axion

Staff Software Engineer, Agentic Platform

Senior individual contributor architecting and scaling agentic LLM systems that turn messy manufacturing data into reliable root-cause insights. Owns orchestration, retrieval, evaluation, and guardrails for non-deterministic production systems.

250k – 270kSan Francisco, CA +1ML EngineeringHybrid7+ YOEMCPobservability
Cohere

Senior Research Engineer - Safety Tooling and Data

Senior Research Engineer building data synthesis, analysis, and management tooling for AI safety model training and evaluation. Requires strong software engineering, statistics, and ML framework expertise.

230k – 380kNew York, NYML EngineeringRemote5+ YOEJAXPython