Skip to content

Senior Software Engineer II, ML/AI Platform

As a Senior Software Engineer II on the ML/AI Platform team, you will build and define the internal platform for training and deploying AI models across the organization. This role involves developing SDKs and supporting infrastructure for AI model fine-tuning and batch inference.

192k – 242kUnited StatesML EngineeringRemote3+ YOE

About the role

About the Job

As a Senior Engineer on the ML/AI platform team, you will play a key role in building the internal platform which supports training and deploying AI models across the entire organization. You’ll take ownership of defining the platform to enable AI model fine-tuning and batch inference by building the SDKs and supporting the infra to support these unique workloads. We are looking for someone with high ownership and the ability to be a leader in the space.

  • Excited to build platform-level tools, SDKs
  • Ability to manage cross-cutting stakeholder relationships, prioritizing customer needs first
  • Eager to navigate ambiguous, hairy, and technical problem spaces
  • Eager to jump into domains, languages, and problem areas that might be new and unfamiliar

Minimum Qualifications

  • Bachelor’s degree in Computer Science, a related field, or equivalent practical experience
  • 3 years of experience with software development in one or more programming languages
  • 2 years of experience in designing, analyzing, and troubleshooting large-scale distributed systems, and 1 years of experience leading projects and providing technical leadership
  • Strong proficiency in maintaining high standards for production services
  • Rapid coding skills and management of production services
  • Experience with high scale throughput and distributed systems problems

Preferred Qualifications

  • Strong communication skills and ability to contextualize problems across various audiences
  • Skilled at navigating ambiguity and involving the right stakeholders to address issues efficiently
  • Experience building and shipping products to users
  • Expertise building platforms and high scale infrastructure
  • Visionary thinker capable of generating transformative ideas
  • Prior experience working with AI Platforms like Ray is a plus

Compensation

Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location.

Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants.

For US based candidates, the base pay ranges for a successful candidate are listed below.

  • CA, NY, CT, NJ: $230,000—$242,000 USD
  • WA: $220,000—$232,000 USD
  • OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI: $211,000—$222,000 USD
  • All other states: $192,000—$202,000 USD

Skills

PythonJavaGoC++Distributed SystemsRay

Similar roles

ML Engineering jobs

Senior Software Engineer II, AI Labs & Foundations

Instacart is seeking a Senior Software Engineer II for their AI Labs & Foundations team to design, build, and operate high-scale production AI systems. This role involves working on cutting-edge AI experiences like conversational shopping agents and voice AI, requiring expertise in robust software engineering and production AI/ML.

192k – 242kUnited StatesML EngineeringRemote5+ YOEAIRAG

Senior Applied Research Engineer 2

Drive AI system quality through experimentation and applied research on RAG, agents, and retrieval systems for Drata's compliance platform. Own evaluation frameworks, prototype GenAI workflows, and collaborate with engineers to productionize validated approaches.

192k – 260kSan Francisco, CAML EngineeringHybrid6+ YOERAGNLP

Senior AI Developer Productivity Engineer

Develops LLM-powered tools to boost developer productivity 10x, including code assistance, automated reviews, and task automation for autonomy software. Requires 7+ years experience as full-stack/backend developer fluent in Python or C++ with LLM optimization knowledge.

192k – 300kFoster City, CAML EngineeringOn-site7+ YOEC++LLMs

Sr. Machine Learning Engineer

Architects high-scale distributed systems and agentic AI for cybersecurity platform, processing massive data with Kafka, Spark/Flink, and Kubernetes. Requires 5-8 years backend experience in Java/Python/Go and expertise in agentic frameworks, RAG, and cloud infrastructure.

191k – 220kSunnyvale, CAML EngineeringOn-site5+ YOEGoRAG

Senior Software Engineer, GenAI Platform

Leads development of Reddit's large-scale GenAI Platform, including LLM Gateway, RAG applications, and agentic AI workflows. Requires 5+ years in ML/AI platform engineering with expertise in cloud, Kubernetes, and MLOps practices.

191k – 267kUnited StatesML EngineeringRemote5+ YOEGoAWS