Skip to content
Scale AIScale AI

Senior/Staff Machine Learning Engineer, General Agents, Enterprise GenAI

Designs, builds, and deploys production-ready AI agents using LLMs, tool use, and reasoning for enterprise problems. Requires 5+ years ML experience, Python proficiency, and Bachelor's in CS/ML/AI.

About the job

About the Role

As a Senior/Staff Machine Learning Engineer on the General Agents team, you’ll design, build, and deploy production-ready AI agents that solve high-impact enterprise problems. You will work across the full agent lifecycle—from model and system design to evaluation, deployment, and iteration.

You will:

  • Design and implement end-to-end agent systems that combine LLM reasoning, tool use, memory, and control logic to solve recurring enterprise use cases.
  • Build scalable, reliable agent architectures that can be deployed across many customers with varying data, tools, and constraints.
  • Develop evaluation frameworks, datasets, environments, and metrics to measure agent performance, reliability, and business impact in production settings.
  • Collaborate closely with product managers, customers, data annotators, and other engineering teams to translate enterprise requirements into robust agent designs.
  • Productionize frontier agent techniques (e.g., planning, multi-step reasoning and tool-use, multi-agent patterns) into maintainable, observable systems.
  • Own deployment, monitoring, and iteration of agent systems, including failure analysis and continuous improvement based on real-world usage.
  • Contribute to technical direction and architectural decisions for general agent development best practices and methods, with increasing scope and leadership at the Staff level.

Ideally you’d have:

  • 5+ years of experience building and deploying machine learning or AI systems for real-world, production use cases.
  • Strong engineering fundamentals, supported by a Bachelor’s and/or Master’s degree in Computer Science, Machine Learning, AI, or equivalent practical experience.
  • Deep understanding of modern LLMs, prompt-, context-, and system-level optimization, and agentic system design.
  • Proven proficiency in Python, including writing production-quality, testable, and maintainable code.
  • Experience building systems that integrate models with external tools, APIs, databases, and services.
  • Ability to operate in ambiguous problem spaces, balancing research-driven approaches with pragmatic product constraints.
  • Strong communication skills and comfort working in customer-facing or cross-functional environments.

Nice-to-haves:

  • Hands-on experience building AI agents using modern generative AI stacks (OpenAI APIs, commercial or open-source LLMs).
  • Experience with agent frameworks, orchestration layers, or workflow systems (e.g., tool calling, planners, multi-agent setups).
  • Familiarity with evaluation, monitoring, and observability for LLM-powered systems in production.
  • Experience deploying ML systems in cloud environments and operating them at scale.
  • Experience fine-tuning or adapting foundation models using methods like supervised fine-tuning (SFT), reinforcement learning with verifiable rewards (RLVR), and low-rank adaptation (LoRA) to improve agent performance on domain-specific tasks.

Skills

Python, LLMs, Machine Learning, AI Agents, Llm Reasoning, Tool Use, Evaluation Frameworks, Cloud Deployment, Fine-Tuning, Openai Apis

Idme

Idme

Mountain View, CA

Staff Software Engineer - AI Agent Evaluations
$218k+/yrOn-site8+ YOEML Engineering

Leads the engineering discipline for evaluating, testing, and monitoring production AI agents, while building scalable eval infrastructure and developer tooling. Requires 8+ years of production software experience, strong backend skills, and expertise with LLM evaluation and agentic systems.

Perplexity

Perplexity

San Francisco, CA

Member of Technical Staff
$220k+/yrOn-siteML Engineering

Build AI agent harnesses, models, and product capabilities that enable agents to perform complex work across digital environments. The role combines applied AI research and software engineering, requiring Python proficiency, strong product judgment, and experience with agent tooling, reinforcement learning, or browser technologies.

Ironclad

Ironclad

San Francisco, CA

Senior Staff Software Engineer, Agentic Search
$220k+/yrHybrid10+ YOEML Engineering

Leads architecture and technical direction for agentic search systems combining LLMs, retrieval, and content-understanding pipelines for contract intelligence. The role requires 10+ years building production systems, deep search or LLM expertise, and strong cross-team technical leadership.

Mercor

Mercor

San Francisco, CA

Member of Technical Staff, Enterprise Evals Platform
$220k+/yrOn-siteML Engineering

Builds the platform, verifiers, environments, and grading infrastructure used to evaluate enterprise AI agents at scale. The role combines strong software engineering with expertise in agent runtimes, evaluation design, benchmarks, and production failure analysis.

Mercor

Mercor

New York, NY

Member of Technical Staff, Deeptune
$220k+/yrOn-site4+ YOEML Engineering

Build scalable backend and infrastructure systems for reinforcement-learning environments that train AI agents, partnering with researchers and leading AI labs. The role requires strong engineering judgment, hands-on leadership, and experience with ML/LLM concepts and scalable systems.