Software Engineer
Build and own a mission-critical research platform for evaluating AI model capabilities and behaviors at xAI. Design instruments, datasets, grading schemes, and infrastructure to measure, diagnose, and improve models while shipping delightful internal tools.
About the job
Responsibilities
- Own and elevate our mission-critical research platform that directly accelerates xAI’s frontier work.
- Design, build, and ship delightful and bulletproof systems that engineers love to use every day.
- Create and execute instruments for measuring model capabilities and behaviors.
- Use instruments to clean datasets, provide feedback for experiments, and track growth throughout training.
- Diagnose why agents fail and how to make improvements both short and long term.
- Manage the execution infrastructure, design data sets and grading schemes.
Requirements
- Software engineering proficiency and 3+ years of experience actively writing code.
- A track record of shipping high quality projects and a strong sense of urgency.
- Exceptional product taste - you have a sharp sense for what “good” looks like in outputs, and you can translate fuzzy notions of quality, helpfulness, truthfulness, and safety into concrete, measurable criteria.
- Strong attention to detail.
Nice-to-Haves
- Previously founded a startup or joined a fast-growing early-stage startup.
- Familiarity with AI/ML workflows, annotation tools, or evals.
- Experience creating and maintaining component libraries, design systems, or internal tools.
Compensation and Benefits
- $175,000 - $275,000 USD base salary.
- Equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
Skills
Software Engineering, Ai/Ml Workflows, Annotation Tools, Evals, Component Libraries, Design Systems, Internal Tools
Similar jobs
ML Engineering jobs
Mirage
New York, NY
Build and deploy agentic systems that power AI-driven creative video workflows. The role requires 5+ years of experience, production ML or agentic pipeline development, context engineering, and expertise in evaluation and agent infrastructure.
Mirage
New York, NY
Build and advance agentic machine-learning systems for multimodal creative tasks, with a focus on video understanding, reasoning, control, and tool use. The role requires strong production ML or agent-pipeline experience and deep knowledge of modern LLM techniques.
Taste Labs
San Francisco, CA
Build evaluation methods, RL environments, agent tooling, and scalable infrastructure that make subjective qualities such as design and taste measurable for frontier AI models. The role requires experience with evaluations, RL environments, ML or post-training, plus strong backend engineering skills.
Mirage
New York, NY
Build and scale generative video and multimodal models, optimizing training and inference for efficiency, throughput, and ultra-low latency. The role requires deep learning systems expertise, strong PyTorch/CUDA experience, and the ability to move research models into production.
Clay
New York, NY
Build and ship production AI agents and the platform infrastructure that makes them reliable, steerable, and measurable. The role requires strong backend fundamentals, production LLM or agent experience, and expertise in evaluations, retrieval, orchestration, or tool-use design.