# Senior Member of Technical Staff, Web Data

**Company:** [Cohere](https://hotfix.jobs/companies/cohere)
**Location:** Remote
**Role:** Data Engineering
**Experience:** 5+ years
**Skills:** Python, Data Pipelines, Spark, Apache Beam, pandas, Web Data, Data Deduplication, Data Filtering, Data Quality Assessment, Natural Language Processing, Ai Model Training
**Posted:** 2026-06-01

> Build and operate large-scale web data pipelines for pretraining language models, including extraction, filtering, quality scoring, deduplication, and corpus analysis. The role requires strong Python and data-engineering skills, experience with large web datasets, and collaboration across research and engineering teams.

## Job Description

## Responsibilities
- Maintain large-scale pipelines for processing web corpora.
- Build filtering and quality-scoring systems to identify high-value web documents.
- Analyze web data composition across domains, languages, and time periods.
- Develop and maintain highly performant deduplication pipelines.
- Collaborate with researchers and engineers to ensure data pipelines meet the demands of language models.

## Requirements
- Strong software engineering skills.
- Proficiency in Python and experience building data pipelines.
- Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools.
- Experience working with large-scale web datasets.
- Knowledge of data quality assessment techniques and experimentation with data mixtures.
- Passion for bridging research and engineering to solve complex data-related challenges in AI model training.

## Nice-to-haves
- A paper at a top-tier venue such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, or EMNLP.

## Compensation and Benefits
- Weekly lunch stipend of $75/£75 or equivalent in local currency.
- Full health and dental benefits, including a separate mental-health budget.
- RRSP matching, 401(k), or pension scheme.
- 100% parental-leave top-up for up to 6 months for either parent.
- Annual enrichment benefits for arts and culture, fitness and wellness, quality time, and workspace improvements.
- Education and learning stipend for conferences, courses, and coaching.
- Six weeks of paid vacation (30 working days).
- Budget for travel to other offices if remote, plus an annual company offsite.
- Coworking benefit for employees not near an office.
- $500 home-office stipend.

## Similar jobs

- [Engineering Manager, Reference Data](https://hotfix.jobs/jobs/17fe7937-a65b-4fd1-bb4d-255cbac4d600) - Addepar - Remote
- [Senior Data Engineer](https://hotfix.jobs/jobs/87b44df0-4459-4294-af40-945c2cbeaa59) - Alpaca - Remote
- [Senior Database Reliability Engineer II](https://hotfix.jobs/jobs/312b25c1-28c7-4373-b975-fe05277359f7) - NinjaTrader - Remote - $130k – $180k/yr
- [Senior Data Engineer Backend](https://hotfix.jobs/jobs/6ffdb9f9-b51f-4098-9718-084b0c6a13df) - Flaglerhealth - Vancouver, Canada
- [AI Data Readiness Lead](https://hotfix.jobs/jobs/456fe66b-aa42-4f78-a5f7-99231661da49) - Deepgram - Remote - $165k – $220k/yr

**Apply:** https://hotfix.jobs/jobs/0a30870a-60f9-4464-ad9d-f8aa1e605bc0
**Canonical:** https://hotfix.jobs/jobs/0a30870a-60f9-4464-ad9d-f8aa1e605bc0