Skip to content
Scale AIScale AISan Francisco, CA

Senior/Staff Machine Learning Engineer, General Agents, Enterprise GenAI

Designs, builds, and deploys production-ready AI agents using LLMs, tool use, and reasoning for enterprise problems. Requires 5+ years ML experience, Python proficiency, and Bachelor's in CS/ML/AI.

218k – 273k/yr
Hybrid5+ YOEML Engineering

About the role

About the Role

As a Senior/Staff Machine Learning Engineer on the General Agents team, you’ll design, build, and deploy production-ready AI agents that solve high-impact enterprise problems. You will work across the full agent lifecycle—from model and system design to evaluation, deployment, and iteration.

You will:

  • Design and implement end-to-end agent systems that combine LLM reasoning, tool use, memory, and control logic to solve recurring enterprise use cases.
  • Build scalable, reliable agent architectures that can be deployed across many customers with varying data, tools, and constraints.
  • Develop evaluation frameworks, datasets, environments, and metrics to measure agent performance, reliability, and business impact in production settings.
  • Collaborate closely with product managers, customers, data annotators, and other engineering teams to translate enterprise requirements into robust agent designs.
  • Productionize frontier agent techniques (e.g., planning, multi-step reasoning and tool-use, multi-agent patterns) into maintainable, observable systems.
  • Own deployment, monitoring, and iteration of agent systems, including failure analysis and continuous improvement based on real-world usage.
  • Contribute to technical direction and architectural decisions for general agent development best practices and methods, with increasing scope and leadership at the Staff level.

Ideally you’d have:

  • 5+ years of experience building and deploying machine learning or AI systems for real-world, production use cases.
  • Strong engineering fundamentals, supported by a Bachelor’s and/or Master’s degree in Computer Science, Machine Learning, AI, or equivalent practical experience.
  • Deep understanding of modern LLMs, prompt-, context-, and system-level optimization, and agentic system design.
  • Proven proficiency in Python, including writing production-quality, testable, and maintainable code.
  • Experience building systems that integrate models with external tools, APIs, databases, and services.
  • Ability to operate in ambiguous problem spaces, balancing research-driven approaches with pragmatic product constraints.
  • Strong communication skills and comfort working in customer-facing or cross-functional environments.

Nice-to-haves:

  • Hands-on experience building AI agents using modern generative AI stacks (OpenAI APIs, commercial or open-source LLMs).
  • Experience with agent frameworks, orchestration layers, or workflow systems (e.g., tool calling, planners, multi-agent setups).
  • Familiarity with evaluation, monitoring, and observability for LLM-powered systems in production.
  • Experience deploying ML systems in cloud environments and operating them at scale.
  • Experience fine-tuning or adapting foundation models using methods like supervised fine-tuning (SFT), reinforcement learning with verifiable rewards (RLVR), and low-rank adaptation (LoRA) to improve agent performance on domain-specific tasks.

Skills

PythonLLMsMachine LearningAI AgentsLlm ReasoningTool UseEvaluation FrameworksCloud DeploymentFine-TuningOpenai Apis

Similar roles

ML Engineering jobs
Typeface

Staff ML Engineer

TypefacePalo Alto, CA

Builds and scales ML models/systems for Generative AI content generation (text, image, audio, video). Owns roadmaps, processes for training/fine-tuning at scale, and collaborates cross-functionally. Requires 10+ YOE, Master's/PhD, Python/C++ proficiency.

218k – 234k/yr
Hybrid10+ YOEML Engineering
Coinbase

Staff Machine Learning Engineer

CoinbaseUnited States

Staff ML Engineer leading end-to-end identity verification ML systems including document authenticity, face matching, liveness detection, GNN-based identity graphs, and behavioral risk models. Requires 8+ years production ML experience and domain expertise in biometrics or fraud detection.

218k – 257k/yr
Remote8+ YOEML Engineering
Idme

Staff Software Engineer - AI Agent Evaluations

IdmeMountain View, CA

Staff-level engineer defining and leading AI agent evaluation frameworks, building eval infrastructure, and establishing production observability for LLM-powered systems. Requires 8+ years experience and deep expertise in testing non-deterministic AI agents.

218k – 271k/yr
On-site8+ YOEML Engineering
Zoox

Senior/Staff Software Engineer - Planner Frameworks Pipeline

ZooxFoster City, CA +1

Build and optimize large-scale simulation and ML training pipelines on Ray and Kubernetes to validate autonomous vehicle behavior. Requires 8+ years experience and strong distributed systems background.

219k – 315k/yr
Hybrid8+ YOEML Engineering
Grow Therapy

Staff Software Engineer - ML Platform

Grow TherapySan Francisco, CA +2

As a Staff ML Platform Engineer, you will drive the technical vision and execution of Grow Therapy's Machine Learning Platform, designing and building large-scale, real-time ML systems to power core product experiences like patient-provider matching.

217k – 289k/yr
Hybrid7+ YOEML Engineering