Staff Software Engineer, AI Platform

Responsibilities

• Design and build the agent infrastructure that powers Watershed's products
• Develop the observability and tracing layer for agent decisions, making it possible to debug, evaluate, and improve agent behavior at scale
• Build evals, harnesses, and guardrails that turn agent capabilities into production-grade, dependable systems
• Collaborate with product and other AI engineering teams to set product and technical strategy, and define the boundaries between autonomous agent behavior, deterministic code, and human oversight
• Keep up with developments and state-of-the-art in AI and agent infrastructure to determine what is relevant to Watershed
• Work closely with Watershed product teams to contribute your expertise to build agent experiences across the product
• Write performant, well-crafted, tested, and maintainable code across our technical stack

Requirements

• 6+ years of experience in backend, platform, or AI/ML engineering
• Experience building products and infrastructure that leverage LLMs, embeddings, and other ML technologies
• Full lifecycle experience building, deploying, and monitoring production systems that depend on LLMs or other ML technologies
• Experience with model evaluation, agent observability, and making non-deterministic systems reliable
• Experience building and operating production Typescript systems
• Must be willing to work from an office 4 days per week