Member of Technical Staff, Retrieval & Indexing
Build and operate large-scale web indexing systems including corpus selection, searchable structures, quality/freshness models, and low-latency query serving. Requires deep expertise in information retrieval and distributed systems.
About the job
Responsibilities
- Build and operate systems for large-scale full-text indexing over the web
- Decide what belongs in the corpus
- Build searchable structures that hold the corpus
- Build signals and models that judge source quality and freshness
- Serve queries against the index quickly and economically
- Anticipate bottlenecks and ensure architecture evolves to meet increasing demand
Requirements
- Deep intuition on information retrieval, distributed systems, and performance tuning
- Ability to reason about trade-offs between classical and neural retrieval
- Ability to reason about trade-offs between cost, reliability, and latency
- Care about helping agents find the right information
- Care about infrastructure that can support products used by millions
Nice-to-Haves
- Experience with large-scale web indexing systems
Skills
Information Retrieval, Distributed Systems, Performance Tuning, Classical Retrieval, Neural Retrieval, Full-Text Indexing, Query Serving, Source Quality Modeling, Freshness Signals, Large-Scale Systems
Similar jobs
Backend Engineering jobs
Beacon Biosignals
United States
Senior Software Engineer designing and scaling backend data infrastructure for clinical and scientific applications. The role requires 5+ years of backend experience, strong PostgreSQL and SQL expertise, event-streaming experience, and proficiency in Julia or Python.
Vannevar
United States
Senior software engineer responsible for advancing a state-of-the-art search and information retrieval platform, improving relevance and latency while collaborating with ML, product, and mission teams. Requires 7+ years of backend development experience and deep expertise in search, NLP, and machine learning.
Fingerprint
Remote
Build and operate highly performant Core API services for real-time fraud detection, owning reliability, observability, scaling, and production operations. The role requires 5+ years of backend experience with Go or Node.js and strong SRE practices.
Taskrabbit
San Francisco, CA
The Software Architect will drive hands-on platform modernization across engineering teams, pairing with developers and guiding adoption of target-state architecture, AI-assisted development, and spec-driven practices. The role requires 8+ years of backend software development experience and expertise in distributed, event-driven systems.
Censys
United StatesBuild and maintain highly available, scalable distributed services, data pipelines, and platform capabilities that power Internet intelligence and security products. The role requires 5+ years of distributed-systems software engineering experience and proficiency with Go, cloud platforms, messaging systems, and databases.