Member of Technical Staff - Pre-Training

Responsibilities

• Design and implement petabyte-scale, high-throughput data processing systems that involve both CPU- and GPU-based processing.
• Design and implement tools for orchestrating complex data pipelines.
• Design and implement innovative tools for improving data discoverability and data quality at scale for both pre-training and post-training across different modalities.
• Build, run, and manage innovative data pipelines for creating high-quality training data.

Basic Qualifications

• Strong systems skills in configuring and troubleshooting complex distributed data processing systems for maximum performance.
• Building bespoke data processing systems from scratch.
• Preparing pre-training and post-training data for state-of-the-art large language models and generative models.
• Organizing and meticulously bookkeeping data across multiple clouds, of multiple modalities, and from many sources.

Compensation and Benefits

• $180,000 - $440,000 USD
• Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.