Senior Software Engineer - Search
Senior software engineer developing ML-based search relevance and discovery systems, including query understanding, ranking, retrieval, and evaluation pipelines. The role requires 5+ years of search relevance experience and expertise in NLP, LLMs, or related discovery technologies.
About the job
Key Responsibilities
- Drive the development and deployment of ML-based search and discovery relevance models and systems integrated with Databricks products and services.
- Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewriting, ranking and retrieval, and model evaluation.
- Collaborate with product managers and cross-functional teams on search and discovery initiatives and product roadmaps.
- Build a robust framework for evaluating search-ranking improvements, both offline and online.
Requirements
- Bachelor’s degree or higher in Computer Science or a related field; master’s or PhD preferred.
- 5+ years of experience developing search relevance systems at scale in production or high-impact research environments.
- Experience applying large language models to search relevance.
- Experience with one or more of query understanding, NLP, text mining, recommendations, personalization, discovery, or conversational AI.
- Strong computer science fundamentals.
- Contributions to well-used open-source projects.
Compensation and Benefits
- Comprehensive benefits and perks are offered, with region-specific details available from Databricks.
Skills
Machine Learning, Natural Language Processing, LLMs, Search Relevance, Query Understanding, Query Rewriting, Information Retrieval, Ranking, Text Mining, Recommendations, Personalization, Conversational AI, Model Evaluation, Open Source
Similar jobs
ML Engineering jobs
GitLab
Bengaluru, India
Build and ship autonomous, agentic software development lifecycle capabilities, including AI agents, orchestration, and safety guardrails. The role requires senior software engineering experience, proficiency in Ruby, Go, or Python, distributed systems knowledge, and experience with AI/ML applications.
Airbnb
Bengaluru, India
Build and operate scalable AI/ML systems and pipelines that strengthen Airbnb’s fraud prevention and trust defenses. The role requires 7+ years of backend or platform engineering experience, strong programming and data engineering skills, and production machine learning expertise.
Together AI
Amsterdam, Netherlands
Build production AI agents and the distributed platform that operates large-scale GPU infrastructure. The role requires 5+ years of backend, distributed systems, or infrastructure experience, with expertise in agent systems, knowledge graphs, retrieval, or semantic search.
6sense
Bengaluru, India
Build and deploy explainable machine learning, NLP, LLM, and agentic systems that power enterprise go-to-market intelligence products. The role requires 6+ years of production ML experience, strong Python and cloud skills, and end-to-end ownership from modeling through monitoring.
Databricks
Bengaluru, India
The Senior ML and AI Technical Solutions Engineer troubleshoots and optimizes production data, machine learning, and generative AI workloads on Databricks. The role requires 8+ years of production experience with ML/AI systems, distributed computing, cloud platforms, and programming in Python, Scala, and Java.