# Research Engineer - Web Crawlers

**Company:** [ElevenLabs](https://hotfix.jobs/companies/elevenlabs)
**Location:** Remote
**Role:** Data Engineering
**Skills:** Web Crawlers, Web Scraping, Distributed Systems, Kubernetes, Queue-Based Architectures, Content Extraction, Deduplication, Data Pipelines, Machine Learning, Data Quality
**Posted:** 2026-08-28

> Build and operate distributed web-crawling systems that source, extract, evaluate, and prepare large-scale web data for frontier AI models. The role requires hands-on crawler or scraping experience and strong distributed-systems engineering skills.

## Job Description

## Responsibilities
- Build and operate large-scale, distributed web crawlers that discover, fetch, and extract data across billions of pages reliably and efficiently.
- Solve crawling challenges including messy HTML content extraction, web-scale deduplication, freshness and recrawl strategies, politeness, and rate-limit handling.
- Design targeted crawling pipelines to identify high-value audio, video, and multilingual data sources and convert them into clean, training-ready datasets.
- Create tooling and infrastructure that enables researchers to request, monitor, and explore newly crawled web data quickly and reliably.

## Requirements
- Hands-on experience building and scaling web crawlers or scraping systems, ideally for machine-learning training data.
- Strong distributed-systems engineering skills at scale, including experience with Kubernetes, queue-based architectures, or custom pipelines processing billions of documents.
- Ability to independently evaluate the quality, coverage, and compliance of crawled data and build tooling to measure it.
- Demonstrated ability to solve complex engineering problems through projects, system designs, or open-source contributions.

## Compensation and Benefits
- Annual discretionary professional-development stipend.
- Annual discretionary stipend for meeting colleagues socially.
- Annual company offsite.
- Monthly co-working stipend for employees outside main hubs.

## Similar jobs

- [Analytics Engineer](https://hotfix.jobs/jobs/822824cc-1e77-4173-9f29-dc91ae0bd859) - Bevi - Boston, MA - $134k – $165k/yr
- [Data Engineer, GTM](https://hotfix.jobs/jobs/c0f575bd-fb5a-4a2b-aa6f-1e92c49eecc3) - Anthropic - San Francisco, CA - $320k – $405k/yr
- [Distributed Systems Engineer, Analytical Database Platform](https://hotfix.jobs/jobs/81ca3fba-abf2-4e8e-9e70-a484734b6cc9) - Cloudflare - Atlanta, GA - $54k – $91k/yr
- [Open Science Data Steward](https://hotfix.jobs/jobs/6513fd8c-ddf4-4a8b-b54d-ed97d14710b3) - Astera - Emeryville, CA - $100k – $150k/yr
- [Analytics Engineer, Data Platform](https://hotfix.jobs/jobs/e7f2755f-9557-483a-abd1-b4dae0399143) - Upside - Washington, DC - $149k – $180k/yr

**Apply:** https://hotfix.jobs/jobs/f4fdea9b-4afd-4a81-87e6-ba485500e0a0
**Canonical:** https://hotfix.jobs/jobs/f4fdea9b-4afd-4a81-87e6-ba485500e0a0