# Senior Staff Software Engineer, Indexing & Retrieval Platform

**Company:** [Reddit](https://hotfix.jobs/companies/reddit)
**Location:** Remote
**Role:** Data Engineering
**Salary:** $279k – $391k/yr
**Experience:** 10+ years
**Skills:** Go, Java, Python, Flink, Airflow, Spark, Kubernetes, Docker, AWS, GCP, Milvus, Vespa, Elasticsearch
**Posted:** 2026-04-22

> Leads development and scaling of ML indexing and retrieval infrastructure for Reddit's recommendation systems, integrating lexical/vector search and GenAI. Requires 10+ years in software engineering with 3+ in technical leadership, expertise in distributed systems, stream processing, and cloud-native architectures.

## Job Description

## What You’ll Do

- Lead the technical strategy, architecture, and implementation of Reddit’s next-generation ML Indexing & Retrieval engine, integrating capabilities across lexical and vector indexing, low-latency retrieval, and emerging GenAI applications.
- Partner closely with product engineers across Content Understanding, Search, Feeds, Ads, Growth, and Safety to deliver high-quality experiences.
- Define best practices for observability, reliability, and operational excellence in large-scale distributed systems.
- Mentor and guide engineers in designing scalable infrastructure and adopting robust DevOps and SRE principles.
- Collaborate with infrastructure, and ML teams to ensure the platform evolves to meet the needs of Reddit’s growing user base and diverse content ecosystem.

## Who You Might Be

- **10+ years** of experience in software engineering, specializing in Indexing and Retrieval systems.
- **3+ years** in technical leadership, architecting and scaling distributed systems in production environments.
- Deep expertise in large-scale data platforms, including batch indexing and stream processing.
- Proven experience designing and operating large-scale, low-latency retrieval services.
- Expertise in lexical and vector search retrieval technologies, such as **Milvus**, **Vespa**, or **Elasticsearch**.
- Skilled in designing cloud-native architectures and managing containerized workloads using **Kubernetes** and **AWS/GCP**.
- Adept at translating complex technical challenges into clear, actionable strategies.
- Strong communicator and mentor who leads through collaboration, influence, and technical excellence.

**Languages:** Go, Java, Python, or any object oriented programming language
**Frameworks:** Flink, Airflow, Spark for large scale batch & stream processing
**Databases:** Familiarity with Vector, Lexical & Key-Value Databases
**Tools:** Kubernetes, Docker, AWS, GCP

## Similar roles

- [Member of Technical Staff, Research Engineer (Datasets)](https://hotfix.jobs/jobs/200e0ab6-1de1-439e-82a7-a4740c019e27) - Runway - Remote - $270k – $370k/yr
- [Staff Software Engineer, Data Platform](https://hotfix.jobs/jobs/dbec41b1-0c1c-464e-a4b5-30355952f644) - Scale AI - San Francisco, CA - $248k – $311k/yr
- [Senior Staff Data Engineer](https://hotfix.jobs/jobs/bc9c9ab5-6cc2-46fa-b946-9a0573bc3c46) - Airbnb - Remote - $248k – $310k/yr
- [Staff Data Engineer, Ads](https://hotfix.jobs/jobs/0b6db8e1-bd66-4bea-8c7f-4bf874a31460) - Discord - Remote - $248k – $279k/yr
- [Staff Data Engineer, Analytics](https://hotfix.jobs/jobs/f88dd0d9-357b-4cf7-9be7-8944ed1959e1) - Discord - San Francisco, CA - $248k – $279k/yr

**Apply:** https://hotfix.jobs/jobs/a96bb2ac-4943-47cb-9031-edea86dca526
**Canonical:** https://hotfix.jobs/jobs/a96bb2ac-4943-47cb-9031-edea86dca526