Skip to content
xAIxAIPalo Alto, CA

Member of Technical Staff, Mid-training

Develops multimodal mid-training data pipelines for omni models handling text, image, video, and audio. Requires ML expertise, scaling laws knowledge, experiment design, and strong engineering in large-scale data frameworks like Spark and Ray.

180k – 440k/yr
On-siteML Engineering

About the role

Tech Stack

  • Python
  • JAX and XLA
  • Spark
  • Ray

Focus

  • Scale synthetic coding data to trillions of tokens with large-scale docker verification.
  • Distill the intelligence of flagship models into flash models through synthetic data generation.
  • Optimize mid-training data mixtures to boost the ceiling for RL.
  • Engineer long-context data recipes.
  • Develop robust and diverse evaluation for mid-training checkpoints.

Ideal Experience

  • Expertise in ML and large model scaling, with familiarity across all kinds of scaling laws.
  • Strong ability to design ML experiments.
  • Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities.
  • Strong engineering abilities in Spark, Ray, and other frameworks for large-scale data processing.

Annual Salary Range

$180,000 - $440,000 USD

Benefits

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

Skills

PythonJAXXlaSparkRayMachine LearningLLMsScaling LawsData ProcessingSynthetic Data

Similar roles

ML Engineering jobs
xAI

Member of Technical Staff

xAIPalo Alto, CA

Build and optimize the RL training framework and infrastructure for large-scale workloads at SpaceXAI, from ablations to production runs. Requires experience with distributed systems and proficiency in Python, JAX, Rust, or C++.

180k – 440k/yr
On-site5+ YOEML Engineering
LlamaIndex

Member of Technical Staff, Applied Research

LlamaIndexSan Francisco, CA

Build and productionize vision-language models for document understanding at LlamaIndex. Focus on training, fine-tuning, synthetic data, benchmarking, and turning research prototypes into accurate, low-latency production systems for real-world PDFs, tables, and enterprise docs. Requires 3+ years ML engineering/applied research experience with strong PyTorch skills.

180k – 250k/yr
Hybrid3+ YOEML Engineering
xAI

Member of Technical Staff, Inference

xAIPalo Alto, CA

Build and optimize the high-performance inference platform serving Grok at massive scale. Design distributed serving infrastructure, low-level GPU optimizations, quantization, speculative decoding, and CI/CD for production reliability and low latency.

180k – 440k/yr
On-site5+ YOEML Engineering
Black Forest Labs

Member of Technical Staff

Black Forest LabsSan Francisco, CA

Research Engineer embedded in large-scale multimodal model training at Black Forest Labs (creators of FLUX). Own performance, stability, and low-precision optimizations for production training runs; profile, debug distributed systems, implement GPU kernels, and partner with researchers to ship frontier generative models.

180k – 290k/yr
Hybrid7+ YOEML Engineering
xAI

Member of Technical Staff - X Search

xAIPalo Alto, CA

Develops and operates large-scale search engine infrastructure, including retrieval algorithms, indexing, and ML ranking models integrated with Grok AI. Requires experience with search systems, vector databases, and production ML in Python, Go, or Rust.

180k – 440k/yr
On-siteML Engineering