Senior AI Engineer
Builds and productionizes LLM-powered agent workflows, focusing on orchestration, evaluation, reliability, safety controls, and product iteration. Requires strong agentic systems expertise and engineering skills for scalable AI systems.
About the job
Responsibilities
- Design, build, and productionize agent workflows end-to-end (APIs, tools, evals, monitoring).
- Create safety, cost, and latency controls; build dashboards and alerts for reliability.
- Partner with product/design to invent new interaction patterns and ship them fast.
- Document patterns and mentor engineers on best practices for LLM-powered features.
What we're looking for
- Agentic systems: Function/tool calling, multi-step planning, routing, memory, and retrieval.
- Engineering first: Wire up services, craft eval harnesses, and debug latency/cost at scale.
- LLM breadth: Comfortable comparing models/hosts, prompt strategies, and guardrail techniques.
- Product focus: Instrument outcomes, run A/Bs, and iterate to improve task success rates.
- Opinionated: Deep understanding of technological landscape, making high-level system and granular code design decisions.
Nice to have
- Experience with workflow engines (e.g., Temporal), comfort in full stack engineering.
Compensation
- $165K - $250K salary, $100K-200K equivalent in new hire equity (4 year vest)
Skills
LLMs, Function Calling, Multi-Step Planning, Routing, Memory, Retrieval, Temporal, Prompt Engineering, Guardrails, A/B Testing
Similar jobs
ML Engineering jobs
Lightning AI
New York, NYBuild and optimize large language model training and post-training pipelines, improving model quality, distributed performance, evaluation, and production readiness. The role requires deep PyTorch and transformer experience, strong distributed-systems and software-engineering skills, and expertise in modern LLM optimization techniques.
Upstart
United States
Build and operate backend infrastructure for machine learning model training, serving, feature management, and marketplace simulation. The role requires 6+ years of software engineering experience, distributed systems expertise, and experience with production ML platforms.
Parallel Systems
Los Angeles, CA
Develop and deploy real-time perception and sensor-fusion software for autonomous battery-electric rail vehicles. The role requires strong robotics, geometry-based computer vision, C/C++ and Rust experience, plus hands-on work with multimodal sensors and production systems.
LangChain
New York, NY
Leads hands-on development and deployment of production AI agents and workflows, sets technical standards, and mentors engineers. Requires 4+ years of software engineering experience, production LLM application experience, and strong Python or TypeScript skills.
LegitScript
United States
Owns the full lifecycle of data and ML solutions, from ingestion and feature-ready datasets through production deployment and business-impact measurement. The role combines data engineering, applied machine learning, MLOps, and generative AI to build risk detection capabilities.