# Member of Technical Staff, Pre-Training Data

**Company:** [Cohere](https://hotfix.jobs/companies/cohere)
**Location:** Remote
**Role:** Data Engineering
**Skills:** Python, Data Pipelines, Curriculum Learning, Data Mixing, Data Attribution, Spark, Apache Beam, pandas, Large-Scale Datasets, Web Data, Code Data, Multilingual Corpora, Natural Language Processing, Data Quality Assessment, Data Curation
**Posted:** 2025-06-25

> Builds and improves large-scale pretraining data pipelines, mixtures, and curation methods for Cohere’s language models. The role combines software engineering and research, requiring Python, data-pipeline development, and experience with large datasets and processing frameworks.

## Job Description

## Responsibilities
- Conduct data ablations to assess data quality and experiment with data mixtures to enhance model performance.
- Develop robust data modeling techniques to ensure datasets are structured and formatted for optimal training efficiency.
- Research and implement innovative data curation methods using Cohere’s infrastructure to advance natural language processing.
- Collaborate with researchers and engineers to ensure data pipelines meet the demands of advanced language models.

## Requirements
- Strong software engineering skills, including proficiency in Python and experience building data pipelines.
- Familiarity with curriculum learning, data mixing, and data attribution.
- Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools.
- Experience working with large-scale datasets, including web data, code data, and multilingual corpora.
- Knowledge of data quality assessment techniques and experimentation with data mixtures.
- Passion for bridging research and engineering to solve complex data-related challenges in AI model training.

## Nice-to-haves
- Paper published at a top-tier venue such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, or EMNLP.

## Compensation and Benefits
- Weekly lunch stipend of $75/£75 or equivalent in local currency.
- Full health and dental benefits, including a separate mental health budget.
- RRSP matching, 401K, or pension scheme.
- 100% parental leave top-up for up to six months for either parent.
- Annual enrichment benefits for arts and culture, fitness and wellness, quality time, and workspace improvements.
- Education and learning stipend for conferences, courses, and coaching.
- Six weeks of paid vacation (30 working days).
- Travel budget for remote employees to visit other offices and an annual company offsite.
- Co-working benefit and a $500 home-office stipend for remote employees.

## Similar jobs

- [Analytics Engineer](https://hotfix.jobs/jobs/822824cc-1e77-4173-9f29-dc91ae0bd859) - Bevi - Boston, MA - $134k – $165k/yr
- [Data Engineer, GTM](https://hotfix.jobs/jobs/c0f575bd-fb5a-4a2b-aa6f-1e92c49eecc3) - Anthropic - San Francisco, CA - $320k – $405k/yr
- [Distributed Systems Engineer, Analytical Database Platform](https://hotfix.jobs/jobs/81ca3fba-abf2-4e8e-9e70-a484734b6cc9) - Cloudflare - Atlanta, GA - $54k – $91k/yr
- [Open Science Data Steward](https://hotfix.jobs/jobs/6513fd8c-ddf4-4a8b-b54d-ed97d14710b3) - Astera - Emeryville, CA - $100k – $150k/yr
- [Analytics Engineer, Data Platform](https://hotfix.jobs/jobs/e7f2755f-9557-483a-abd1-b4dae0399143) - Upside - Washington, DC - $149k – $180k/yr

**Apply:** https://hotfix.jobs/jobs/e327cb35-89c4-436d-b13d-2bef18f6d929
**Canonical:** https://hotfix.jobs/jobs/e327cb35-89c4-436d-b13d-2bef18f6d929