Skip to content
NotionNotionSan Francisco, CA

Software Engineer, AI Platform

Build and scale the shared AI platform foundations at Notion, enabling fast and safe shipping of AI products. Requires experience with LLM/ML platforms, strong ownership, and comfort across backend, infrastructure, and product code.

180k – 201k
Hybrid5+ YOEML Engineering

About the role

What You'll Achieve

  • Own and play a pivotal role in the prototyping, development and scaling of systems and core AI platform primitives.
  • Partner closely with product teams to provide paved paths and production-ready guardrails that help new AI features ship faster with less duplicated work.
  • Work across infrastructure, shared libraries, APIs, and product integration points to make AI platform capabilities easy to adopt and high-leverage across Notion.
  • Operate critical AI systems in production, using observability and diagnostics to understand provider/model behavior, debug failures, improve latency and cost, and evolve systems with minimal user disruption.
  • Help Notion safely adopt new models, providers, and AI capabilities through versioning, controlled rollouts, compatibility layers, and clear quality/reliability gates.

Skills You'll Need to Bring

  • Passion for AI systems at scale: You’ve worked on LLM, ML platform, data, or infrastructure teams that own critical shared systems. You understand the challenges of scaling reliability, latency, cost, and quality as usage and model complexity grow. You care deeply about building platforms that are dependable, efficient, and easy for other engineers to use.
  • Adaptable and curious: You like going deep on how systems behave in practice, especially when models, providers, and product requirements are changing quickly. You’re eager to use AI tools to work smarter and are willing to move across backend, infrastructure, libraries, and product code when that’s what the problem requires.
  • Extreme ownership: You’re comfortable working across ambiguous problem spaces, aligning stakeholders around a clear path forward, and driving execution with accountability. You take ownership of platform outcomes including reliability, quality, adoption, and operational follow-through beyond team boundaries.
  • Thoughtful problem-solving: For you, problem-solving starts with a clear and accurate understanding of the context. You can decompose ambiguous system behavior, debug across layers, and work toward clean, pragmatic solutions by yourself or with teammates. You’re comfortable asking for help when you get stuck.
  • Pragmatic and business-oriented: You understand that AI platform work is full of tradeoffs across quality, latency, cost, reliability, and speed of execution. You prioritize based on product and business impact, balancing craft with urgency and operational simplicity.

Nice to Haves

  • 2-4 years of experience as a Software Engineer
  • Experience with applied AI product development (prompting, evals, model integrations, or quality measurement).
  • You've built out and scaled data processing pipelines at scale with Apache Spark or Ray.
  • You’ve past experience working full-stack in Typscript and node.js ecosystem
  • You have experience building MLOps and ML serving infrastructure.

Compensation

For roles based in San Francisco or New York City, the estimated base salary range for this role is $180,000 - $201,000 per year.

Skills

LLMsMl PlatformData ProcessingSparkRayTypeScriptNode.jsMLOpsMl ServingObservabilityAPIsInfrastructure

Similar roles

ML Engineering jobs
Exa

Research Engineer, Generalist

ExaSan Francisco, CA

Generalist Research Engineer working across Exa's search and retrieval stack including crawling, parsing, ML performance, and retrieval algorithms to improve search quality and performance for customers.

180k – 350k
On-siteML Engineering
Baseten

Software Engineer - BIS

BasetenSan Francisco, CA

As a Software Engineer on the Inference Stack team, you will build the distributed runtime that powers large-scale LLM inference. This role involves working across the stack, from developer experience to low-level infrastructure, and owning systems in production.

180k – 360k
HybridML Engineering
Build

AI Engineer (Core)

BuildSan Francisco, CA

Builds core infrastructure for production AI agents including runtime, evaluation systems, retrieval, tool orchestration, observability, and reliability features for high-stakes real estate workflows. Requires strong systems engineering with Python, backend, and LLM experience.

180k – 250k
On-siteML Engineering
Lightning AI

Research Engineer

Lightning AINew York, NY +1

Develops performance optimizations for ML models across graph, kernel, and system levels using PyTorch and Thunder compiler. Builds tools, collaborates with partners, and contributes to open-source while requiring strong PyTorch expertise and optimization experience.

180k – 250k
RemoteML Engineering
Rillet

Applied AI Engineer

RilletSan Francisco, CA +1

Designs and ships production AI systems including agentic workflows, RAG pipelines, and LLM integrations for an AI-native ERP platform serving finance teams. Requires 3+ years backend experience and 2+ years production AI with Python proficiency.

180k – 240k
Hybrid3+ YOEML Engineering