Senior Software Engineer, AI Agent & LLM

Your Impact

• Build AI-agent experiences for Otter AI Chat that help users reason over conversations, retrieve knowledge, and complete complex tasks.
• Advance Otter’s conversational knowledge engine through better knowledge extraction, annotation, and indexing.
• Develop robust evaluation datasets, automated graders, regression tests, and release gates for AI quality.
• Diagnose failures across models, prompts, retrieval, tools, data pipelines, backend services, and product workflows.
• Build shared agent infrastructure for orchestration, tracing, debugging, retries, sandboxed execution, and observability.
• Improve task completion, correctness, groundedness, reliability, latency, and cost.
• Turn production traces, customer feedback, and usage signals into measurable product and model improvements.
• Collaborate across AI, product, infrastructure, data, security, and application teams to deliver end-to-end capabilities.

Requirements

• 5+ years of AI Agent engineering, machine learning engineering, or related experience.
• Strong backend or distributed-systems engineering skills.
• Hands-on experience building and shipping AI-agent or LLM-powered products.
• Strong focus on AI quality and experience evaluating nondeterministic systems.
• Ability to use data, traces, logs, and qualitative examples to identify and resolve complex failures.
• Works effectively across services, technical domains, and organizational boundaries.
• Combines strong product judgment with rigorous engineering and evaluation practices.
• High agency, strong ownership, and a bias toward action.
• Ability to take ambiguous problems from initial exploration through production launch and continuous improvement.
• Demonstrated ability to use coding agents effectively while rigorously reviewing and controlling the quality of their output is a plus.

Compensation

Salary Range: $185,000 to $230,000 USD per year. This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.