Senior Staff Software Engineer - Search Quality
Leads search quality for AI-agent retrieval and human search experiences, optimizing hybrid retrieval, ranking, relevance metrics, and evaluation frameworks. The role requires expertise in information retrieval, embeddings, Elasticsearch or Lucene, and RAG.
About the job
Responsibilities
- Own the quality of search results for AI agents and human users.
- Optimize retrieval layers so LLMs can access accurate ground truth for business actions.
- Improve traditional search experiences with intuitive, high-recall interfaces.
- Balance keyword-based search with semantic vector search in hybrid retrieval systems.
- Fine-tune ranking models for human-readable results and LLM-ready context.
- Build guardrails and relevance scoring to reduce hallucinations and keep AI grounded.
- Connect structured SQL tables, unstructured documents, and real-time business metrics.
- Build evaluation frameworks using human-in-the-loop and LLM-based approaches.
Requirements
- Experience with information retrieval, including Lucene or Elasticsearch, embeddings, and ranking algorithms.
- Strong understanding of search relevance and evaluation metrics such as nDCG, MRR, and Precision@K.
- Interest in applying traditional information retrieval techniques to retrieval-augmented generation (RAG).
Benefits
- Comprehensive benefits and perks tailored to employees' regional needs.
Skills
Information Retrieval, Lucene, Elasticsearch, Embeddings, Ranking Algorithms, Ndcg, Mrr, Precision@K, RAG, LLMs, SQL, Vector Search
Similar jobs
Data Science jobs
Databricks
Bengaluru, India
Owns search quality across hybrid retrieval systems serving AI agents and human users. The role focuses on ranking, relevance evaluation, embeddings, and grounding RAG outputs across heterogeneous enterprise data.
Airbnb
Gurugram, India
Leads advanced analytics for Airbnb’s Community Support business, partnering with product and business leaders on experimentation, scalable data solutions, forecasting, machine learning, and AI-first workflows. Requires 8+ years of experience, advanced quantitative training, expert SQL, advanced Python, and strong stakeholder leadership.
Vanta
Remote
The Senior Data Scientist will build scalable product analytics assets, measurement frameworks, and AI-assisted analytical workflows while partnering with cross-functional teams to guide product and business decisions. The role requires 4+ years of applied data experience and strong SQL, programming, statistics, machine learning, and experimentation skills.
Celonis
Bengaluru, India
Develop statistical and machine learning models, experimentation, visualizations, and foundation-model solutions to deliver operational insights and support strategic decisions. Requires a bachelor’s degree and 3+ years of relevant analytics or data experience in SaaS or enterprise software.
Metropolis
Bengaluru, India
The Data Scientist will analyze large datasets, build and deploy machine learning models, conduct statistical testing, and communicate actionable insights. The role requires 4+ years of experience, strong Python and SQL skills, and a bachelor's or master's degree in a quantitative field.