Software Engineer, Backend
Builds and optimizes backend systems for massive-scale web crawling, data processing pipelines handling millions of documents daily, and high-performance vector databases in Rust for AI search applications. Requires expertise in high throughput, low latency systems.
About the job
Desired Experience
- Experience writing and maintaining high throughput, low latency systems
- Build data processing pipelines that deal with millions of documents per day
- Comfortable optimizing a system to an exceptional degree
- Care about the problem of finding high quality information
Plus: Experience in some high performance language (C++, Rust, etc.)
Example Projects
- Recreate Google-level keyword search over 10 billion pages in 1 month
- Build a state-of-the-art crawling system that works optimally for any website
- Build a custom vector database that runs over a billion vectors in under 100ms
Skills
Rust, C++, Vector Databases, Data Processing Pipelines, High Throughput Systems, Low Latency Systems, Crawling Systems, Kubernetes, GCP
Similar jobs
Backend Engineering jobsBuild secure, scalable identity and access management platforms, APIs, and internal tooling using JavaScript, Node.js, React.js, and distributed-systems expertise. The role requires 5+ years of backend or distributed-systems experience and familiarity with authentication protocols is a plus.
Build backend systems and APIs that ingest, process, and route large-scale telemetry data in real time. The role requires strong computer science fundamentals, Node.js/TypeScript experience, distributed-systems knowledge, and ownership of reliable cloud software.
Build and maintain highly available, scalable distributed systems, data pipelines, messaging systems, and services powering Internet intelligence products. The role requires 5+ years of distributed-systems experience and proficiency with Go, cloud platforms, databases, and messaging technologies.
Build and maintain backend systems powering Cash App Taxes, translating complex federal and state tax requirements into reliable filing and e-file functionality. The role requires 4+ years of software development experience, strong system design skills, and a bachelor's degree or equivalent experience.
Build shared Ruby backend foundations for APIs, asynchronous jobs, workflow orchestration, and developer tooling. The role requires 5+ years of software engineering experience, including 3+ years with production Ruby systems, plus expertise in distributed systems and large codebases.