# Senior Software Engineer, AI Agent & LLM

**Company:** [Otter](https://hotfix.jobs/companies/otter)
**Location:** Remote
**Role:** ML Engineering
**Salary:** $185k – $230k/yr
**Experience:** 5+ years
**Skills:** Python, C++, RAG, LLMs, NLP, semantic search, Embeddings, Vector Databases, full-text search, ranking algorithms, search infrastructure
**Posted:** 2026-07-22

> Senior Software Engineer building and optimizing enterprise search infrastructure with LLMs, RAG, semantic search, embeddings, NLP query understanding, and ranking algorithms for Otter.ai's AI meeting tools. Requires Master's in CS, 5+ years in search/recommendation/QA systems, and Python/C++ expertise.

## Job Description

## Responsibilities
- Design, develop, and oversee enterprise search infrastructure using vector databases, full-text search engines, and relational database techniques.
- Develop deep learning-based NLP algorithms to understand user information needs, analyze, reformulate, and suggest search queries.
- Design, implement, and deploy ranking algorithms to deliver the most relevant results and best user experience.
- Evaluate and optimize algorithm accuracy focusing on key metrics.
- Track and analyze end-to-end system performance, leading improvement initiatives.
- Stay informed about latest industry developments and emerging technologies to advance the search system.

## Requirements
- Master's degree in Computer Science or relevant field (PhD a plus).
- 5+ years of experience in search, recommendation, or question answering systems.
- In-depth knowledge of relevance measurement, tuning, and modeling.
- Engineering experience with large language models and RAG systems.
- Expertise in Python and/or C++.
- Exceptional problem-solving skills with meticulous attention to detail.
- Outstanding communication skills to explain complex concepts to non-technical team members.
- Ability to contribute individually and function effectively as part of a team.

## Nice-to-Haves
- Familiarity with embedding-based search systems.

## Similar roles

- [Senior Software Engineer, AI Agent & LLM](https://hotfix.jobs/jobs/7ac725db-de74-4f37-8d56-dc07fc25c944) - Otter - Mountain View, CA - $185k – $230k/yr
- [Sr Software Engineer, Cribl AI](https://hotfix.jobs/jobs/db813bb7-e0aa-4356-accd-71a930299507) - Cribl - Remote - $185k – $215k/yr
- [Sr Machine Learning Engineer, AI Research](https://hotfix.jobs/jobs/dd21fdef-4c0a-480d-916f-128ec97de545) - Cribl - Remote - $185k – $215k/yr
- [Senior Software Engineer, Backend](https://hotfix.jobs/jobs/9fa554df-5b2d-4500-9c56-53ba374cefd4) - Coinbase - Remote - $186k – $219k/yr
- [Senior Software Engineer - AI Platform Team](https://hotfix.jobs/jobs/24cb8d81-486e-4cf5-b3fe-a940677eeced) - Coinbase - Remote - $186k – $219k/yr

**Apply:** https://hotfix.jobs/jobs/72cf7ebe-4b22-4cae-aa2c-87262afcd08a
**Canonical:** https://hotfix.jobs/jobs/72cf7ebe-4b22-4cae-aa2c-87262afcd08a