Senior Member of Technical Staff, Web Data

Responsibilities

• Maintain large-scale pipelines for processing web corpora.
• Build filtering and quality-scoring systems to identify high-value web documents.
• Analyze web data composition across domains, languages, and time periods.
• Develop and maintain highly performant deduplication pipelines.
• Collaborate with researchers and engineers to ensure data pipelines meet the demands of language models.

Requirements

• Strong software engineering skills.
• Proficiency in Python and experience building data pipelines.
• Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools.
• Experience working with large-scale web datasets.
• Knowledge of data quality assessment techniques and experimentation with data mixtures.
• Passion for bridging research and engineering to solve complex data-related challenges in AI model training.

Nice-to-haves

• A paper at a top-tier venue such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, or EMNLP.

Compensation and Benefits

• Weekly lunch stipend of $75/£75 or equivalent in local currency.
• Full health and dental benefits, including a separate mental-health budget.
• RRSP matching, 401(k), or pension scheme.
• 100% parental-leave top-up for up to 6 months for either parent.
• Annual enrichment benefits for arts and culture, fitness and wellness, quality time, and workspace improvements.
• Education and learning stipend for conferences, courses, and coaching.
• Six weeks of paid vacation (30 working days).
• Budget for travel to other offices if remote, plus an annual company offsite.
• Coworking benefit for employees not near an office.
• $500 home-office stipend.