Staff AI Engineer - Multi-Agent Frameworks
Build and maintain a platform for creating and deploying multi-agent AI systems, integrating multiple LLMs and orchestration frameworks like LangGraph. Requires deep expertise in AI backend engineering, evaluation frameworks, privacy, and search integration.
About the job
Key Responsibilities
- Design, develop, and maintain a robust platform to enable users to create and manage AI agents and their interactions.
- Integrate and work with multiple LLMs, ensuring seamless orchestration and scalability for both individual and coordinated agent operations.
- Leverage orchestration frameworks like LangGraph and others to build complex workflows and pipelines that support diverse agent functionalities, including frameworks for multi-agent coordination.
- Develop and implement evaluation frameworks for testing AI agents in challenging and complex scenarios, focusing on individual performance and system-level dynamics.
- Stay at the forefront of AI advancements, incorporating the latest research and technologies into our platform to enhance agent capabilities and collaboration.
- Collaborate with cross-functional teams, including product managers, designers, and frontend engineers, to deliver a seamless user experience for building and deploying intelligent systems.
- Address challenging AI privacy scenarios, ensuring compliance with data protection regulations and best practices within agent-based applications.
- Contribute to improving search capabilities and integrating them into the AI platform to provide agents with essential information access.
Qualifications
- Proven experience working with multiple LLMs (e.g., OpenAI, Anthropic, Cohere, etc.) and understanding their strengths and limitations.
- Expertise in orchestration software like LangGraph or similar frameworks used for building and managing agent workflows.
- Strong background in developing evaluation frameworks for AI systems, particularly in complex testing environments.
- Deep understanding of AI and machine learning fundamentals, with a focus on backend engineering.
- Passion for staying updated with the latest developments in AI and applying them to real-world problems, particularly in the realm of agent technologies.
- Experience with challenging AI privacy scenarios, including data anonymization, secure data handling, and compliance.
- Experience with search technologies and their integration into AI systems.
- Experience building or deploying Multi-Agent Frameworks or Multi-Agent Systems.
Skills
LLMs, LangGraph, OpenAI, Anthropic, Cohere, Multi-Agent Frameworks, Ai Orchestration, Machine Learning, Search Technologies, Backend Engineering
Similar jobs
ML Engineering jobs
Haus
Seattle, WAStaff Machine Learning Engineer building and operating production ML systems for causal marketing measurement, optimization, and planning. The role requires deep statistical and machine learning expertise, production programming experience, cross-functional collaboration, and technical mentorship.
Scale AI
San Francisco, CAStaff engineer responsible for designing and scaling the infrastructure, execution environments, verifiers, and tooling used to train and evaluate AI agents. Requires 8+ years of software engineering experience, strong Python and distributed-systems expertise, and familiarity with sandboxing, high-throughput systems, and LLM workflows.
Airbnb
United States
Senior Staff ML Engineer fine-tunes and optimizes state-of-the-art LLMs for Airbnb's customer support AI products, including AI assistants and autonomous agents. Partners cross-functionally to productionize models at scale. Requires PhD and 10+ years experience with PyTorch.
United States
Leads the technical direction of large-scale ML infrastructure for embedding, recommendation, and personalization systems. The role requires 8+ years of ML engineering experience, expertise in deep learning and distributed training, and strong leadership across research, infrastructure, and production deployment.
Snowflake
Bellevue, WA
Leads the roadmap and technical vision for Snowflake Feature Store, building reliable, high-performance machine learning platform capabilities and supporting technical execution across partner teams. Requires 10+ years of experience with data-serving infrastructure or ML platforms, plus Java and Python expertise.