Skip to content
OtterOtterSeattle, WA

Senior Software Engineer, AI Agent & LLM

Senior Software Engineer building and optimizing enterprise search infrastructure with LLMs, RAG, semantic search, embeddings, NLP query understanding, and ranking algorithms for Otter.ai's AI meeting tools. Requires Master's in CS, 5+ years in search/recommendation/QA systems, and Python/C++ expertise.

185k – 230k/yr
Remote5+ YOEML Engineering

About the role

Responsibilities

  • Design, develop, and oversee enterprise search infrastructure using vector databases, full-text search engines, and relational database techniques.
  • Develop deep learning-based NLP algorithms to understand user information needs, analyze, reformulate, and suggest search queries.
  • Design, implement, and deploy ranking algorithms to deliver the most relevant results and best user experience.
  • Evaluate and optimize algorithm accuracy focusing on key metrics.
  • Track and analyze end-to-end system performance, leading improvement initiatives.
  • Stay informed about latest industry developments and emerging technologies to advance the search system.

Requirements

  • Master's degree in Computer Science or relevant field (PhD a plus).
  • 5+ years of experience in search, recommendation, or question answering systems.
  • In-depth knowledge of relevance measurement, tuning, and modeling.
  • Engineering experience with large language models and RAG systems.
  • Expertise in Python and/or C++.
  • Exceptional problem-solving skills with meticulous attention to detail.
  • Outstanding communication skills to explain complex concepts to non-technical team members.
  • Ability to contribute individually and function effectively as part of a team.

Nice-to-Haves

  • Familiarity with embedding-based search systems.

Skills

PythonC++RAGLLMsNLPsemantic searchEmbeddingsVector Databasesfull-text searchranking algorithmssearch infrastructure

Similar roles

ML Engineering jobs
Otter

Senior Software Engineer, AI Agent & LLM

OtterMountain View, CA

Build and improve AI agent experiences and conversational knowledge engine for Otter AI Chat. Focus on quality evaluation, infrastructure for orchestration/tracing, diagnosing failures across the stack, and driving measurable improvements in task completion, reliability, and cost. Requires 5+ years AI/ML engineering, strong backend/distributed systems skills, and experience shipping LLM-powered products.

185k – 230k/yr
Hybrid5+ YOEML Engineering
Cribl

Sr Software Engineer, Cribl AI

CriblUnited States

Build and productionize AI integrations across Cribl's observability platform. Requires 5+ years building AI features end-to-end with fullstack experience in React, TypeScript/JavaScript, and backend systems plus hands-on LLM/agent work.

185k – 215k/yr
Remote5+ YOEML Engineering
Cribl

Sr Machine Learning Engineer, AI Research

CriblUnited States

Design, train, and productionize ML models and pipelines for AI-enabled security/observability platforms. Requires 4+ years experience with Python, PyTorch/TensorFlow, and modern ML techniques.

185k – 215k/yr
Remote4+ YOEML Engineering
Coinbase

Senior Software Engineer, Backend

CoinbaseUnited States

Build and own agentic AI systems and LLM-powered backend infrastructure in Python and Golang to automate Coinbase customer support and compliance operations end-to-end. Requires 5+ years software engineering experience with production AI/ML systems, microservices, and measurable business impact.

186k – 219k/yr
Remote5+ YOEML Engineering
Coinbase

Senior Software Engineer - AI Platform Team

CoinbaseUnited States

Senior Software Engineer building and operating Coinbase's central LLM and AI agent platform infrastructure. Owns LLM Gateway, knowledge bases, agent runtime, FinOps, evaluation tooling, and cross-team applied AI strategy. Requires 5+ years building ML/AI infrastructure at scale.

186k – 219k/yr
Remote5+ YOEML Engineering