Software Engineer, AI Agents
Build and ship production AI agents on Cloudflare's edge platform using Workers, Durable Objects, and AI tools. Requires strong TypeScript/Rust experience, observability expertise, and hands-on LLM tooling for evals, safety, and multi-agent systems.
About the job
What You Will Do
- Build agents on Workers with Durable Objects for state and short term memory
- Wire tools with the Agent SDK, MCP, and function calling
- Use Vectorize, KV, R2, and D1 for semantic memory, cache, files, and config
- Run models through Workers AI and AI Gateway; integrate third parties when needed
- Create evals, guardrails, and audits. Measure, tune, re-ship fast
- Build agents that summarize, propose fixes, and escalate cleanly to humans
- Expose agent health and metrics in transparent dashboards
- Integrate with queues and webhooks; publish events on Queues or Pub/Sub
- Cut cost per case and time to first response. Prove it with data.
- Take end to end ownership including on call for what you ship (with team support)
- Design and maintain robust observability for distributed AI workflows, implementing structured logging and end-to-end tracing across async service boundaries
- Architect security boundaries for agent-led operations; implementing secure credential handling, multi-layer approval gates, and fine-grained trust scoping for mutative actions.
Must Have
- Demonstrated success shipping production systems. Repos and releases that show real work.
- Strong in TypeScript or Rust on Workers. HTTP, queues, async, performance
- Fluency with Durable Objects, KV or R2, and either D1 or Postgres
- Hands on with model tooling. Prompt I/O, tool calling, evals, safety checks
- Observability mindset. Logs, traces, metrics, redlines
- Experience with a2a/multi-agent frameworks
- Experience developing LLM evaluation frameworks; automated scoring systems, CI-integrated quality gates.
- Bias for simple, scalable designs
Nice to Have
- Workers AI, AI Gateway, and Vectorize in production
- Salesforce or Service Cloud experience. Webhooks and case APIs
- Security depth. Prompt injection protection, secrets detection, PII handling
- OSS agent frameworks. Know what to borrow and what to throw away.
Skills
TypeScript, Rust, Workers, Durable Objects, Kv, R2, D1, Postgres, Vectorize, Workers Ai, Ai Gateway, Agent Sdk, LLMs, Prompt Engineering, Evals
Similar jobs
ML Engineering jobs
Thinking Machines Lab
San Francisco, CA
Build and operate the engineering systems that support post-training research, including reinforcement learning infrastructure, sandboxed execution, data pipelines, and agent scaffolding. The role requires strong Python and systems engineering skills, project ownership, and a relevant bachelor’s degree or equivalent experience.
OpenAI
San Francisco, CA
Build research infrastructure and tooling that enables AI models to design silicon, including reinforcement learning environments, EDA integrations, evaluations, and experiment workflows. The role requires strong software engineering fundamentals and comfort working across research, tooling, and chip-design systems.
Rollstack
United StatesBuild production AI capabilities for automated slide and document generation, working across LLM applications, data analysis, and content generation. The role requires 3+ years in machine learning and NLP, advanced Python, and experience with LLM frameworks and production systems.
ClickUp
United States
Build and operate large-scale ranking and retrieval systems that power search relevance, including hybrid lexical/vector search, embeddings, query understanding, and permission-aware retrieval. Requires a bachelor's degree and 5+ years of ML engineering experience in ranking or information retrieval.
PathAI
Boston, MADevelop and deploy machine learning models for biomedical research and AI products, collaborating with scientific, engineering, and product teams. Requires an advanced quantitative degree, substantial ML experience, Python proficiency, and experience bringing models into production or research applications.