Skip to content

Senior AI Engineer

Builds and productionizes LLM-powered agent workflows, focusing on orchestration, evaluation, reliability, safety controls, and product iteration. Requires strong agentic systems expertise and engineering skills for scalable AI systems.

165k – 250kNew York, NYML EngineeringOnsite

About the role

Responsibilities

  • Design, build, and productionize agent workflows end-to-end (APIs, tools, evals, monitoring).
  • Create safety, cost, and latency controls; build dashboards and alerts for reliability.
  • Partner with product/design to invent new interaction patterns and ship them fast.
  • Document patterns and mentor engineers on best practices for LLM-powered features.

What we're looking for

  • Agentic systems: Function/tool calling, multi-step planning, routing, memory, and retrieval.
  • Engineering first: Wire up services, craft eval harnesses, and debug latency/cost at scale.
  • LLM breadth: Comfortable comparing models/hosts, prompt strategies, and guardrail techniques.
  • Product focus: Instrument outcomes, run A/Bs, and iterate to improve task success rates.
  • Opinionated: Deep understanding of technological landscape, making high-level system and granular code design decisions.

Nice to have

  • Experience with workflow engines (e.g., Temporal), comfort in full stack engineering.

Compensation

  • $165K - $250K salary, $100K-200K equivalent in new hire equity (4 year vest)

Skills

LLMsFunction CallingMulti-Step PlanningRoutingMemoryRetrievalTemporalPrompt EngineeringGuardrailsA/B Testing

Similar roles

ML Engineering jobs

Senior GenAI Software Engineer

Senior engineer building and shipping production-grade GenAI systems for ad creative generation, including multimodal models and interactive playables. Requires 5+ years experience, strong Python/JS skills, and proven LLM production experience.

165k – 230kUnited StatesML EngineeringRemote5+ YOELLMsHTML

Machine Learning Lead (LLM)

Leads a team of senior data scientists developing and deploying LLM-based ML products, defining technical roadmaps, overseeing model training/inference pipelines, and translating outputs into actionable insights for civic applications. Requires 6+ years ML experience and 1+ years leading teams.

165k – 210kUnited StatesML EngineeringRemote6+ YOESQLJAX

Senior Machine Learning Engineer

Build and productionize large-scale recommendation systems, NLP/embedding models, and agentic AI workflows. Requires 6+ years ML/NLP experience and expertise in PyTorch/TensorFlow, RAG, and vector search.

165k – 259kUnited StatesML EngineeringRemote6+ YOERAGLora

Senior Software Engineer, Model Serving

Designs and builds scalable infrastructure for high-throughput, low-latency AI/ML model serving on CPU/GPU. Requires 5+ years in distributed systems, inference expertise, and strong system design skills.

166k – 225kSan Francisco, CAML EngineeringOn-site5+ YOEGPURouting

Senior Machine Learning Engineer - GenAI Platform

Build customer-facing generative AI platform covering ML lifecycle from data generation to agent-building. Requires 4+ years experience in distributed systems and ML platforms, with strong product ownership.

166k – 225kSan Francisco, CAML EngineeringOn-site4+ YOEGoC++