# Human Data Manager

**Company:** [xAI](https://hotfix.jobs/companies/xai)
**Location:** Palo Alto, CA
**Role:** Data Analytics
**Salary:** $100k – $186k/yr
**Experience:** 4+ years
**Skills:** Python, SQL, artificial intelligence, Machine Learning, LLMs, data annotation, data curation, dataset evaluation, multimodal data, Data Analysis, AI Agents
**Posted:** 2026-08-12

> Manages end-to-end human data and evaluation projects for AI systems, partnering with engineering teams to improve training signals, model behavior, and data integrity. Requires cross-functional collaboration, dataset analysis, and experience with annotation or AI/ML data workflows.

## Job Description

## Responsibilities
- Partner with model and engineering teams to understand needs and translate them into high-value data projects and evaluation strategies.
- Own end-to-end delivery of critical data and evaluation projects that capture meaningful training signals and support rapid model development.
- Leverage AI agents and existing platforms to measure data effectiveness and quantify impact, including data yield, evaluation lift, and usage.
- Maintain rigorous data integrity and truthfulness, including validation processes for factual accuracy; prioritize quality over quantity.
- Research and apply techniques for data collection, annotation, generation, and multimodal integration.
- Shape model behavior and domain performance through targeted data work; improve annotation workflows using agents and no/low-code approaches where helpful.
- Manage plans that shape model behavior via data management, optimization, and analysis, including resources and timelines.
- Act as a liaison between engineering, technical staff, and tutoring or Human Data teams to drive alignment and knowledge sharing.
- Collaborate with Human Data Operations and stakeholders to scale projects, share learnings, contribute to demand forecasting, and report status, insights, and blockers.

## Requirements
- Bachelor’s degree, or 4+ years of relevant experience in lieu of a degree.
- Experience collaborating with cross-functional teams, including engineering, research, product, or annotation and operations groups.
- Demonstrated experience analyzing datasets to identify trends, anomalies, quality issues, or integrity problems.

## Nice-to-haves
- Degree in engineering, computer science, data analysis, or a related STEM discipline.
- Experience curating, evaluating, or improving training or evaluation datasets for large language models or other AI/ML systems.
- Experience designing, supporting, or optimizing annotation workflows or data processes that prioritize factual accuracy and data integrity.
- Familiarity with multimodal data or domain-specific data such as science, mathematics, programming, or recent events.
- Experience with model or dataset evaluations focused on quality, truthfulness, or alignment with product goals.
- Comfort using AI agents, no/low-code tools, or light scripting such as Python to prototype workflows and measurement.
- Experience with SQL or other data analysis tools.

## Additional Requirements
- Weekend work may be required.
- Travel to other company sites may be required.

## Compensation and Benefits
- Base salary: **$100,000–$186,000 USD**.
- Equity and comprehensive medical, vision, and dental coverage.
- 401(k) retirement plan.
- Short- and long-term disability insurance.
- Life insurance, discounts, and other perks.

## Similar roles

- [Forward Deployed Analytics Engineer](https://hotfix.jobs/jobs/ab1de27e-ddca-432e-8eef-1f2ecab31363) - Hightouch - Remote - $100k – $160k/yr
- [Healthcare Data and Business Analyst](https://hotfix.jobs/jobs/44de2cac-e215-4744-a3e3-b9f0c569ea83) - Prompt Health - Remote - $100k – $120k/yr
- [Data Analyst, Go-To-Market Sales Insights](https://hotfix.jobs/jobs/b889408e-97c3-43a6-a9e8-7896e76358f6) - Lyft - San Francisco, CA - $98k – $123k/yr
- [Measurement Partner II](https://hotfix.jobs/jobs/e8419af2-dd00-4857-aaf2-40712d2e78a3) - Pinterest - New York, NY - $104k – $214k/yr
- [Measurement Partner II](https://hotfix.jobs/jobs/dcaaa3a0-c3da-43a4-a5c4-1e8ab61735a0) - Pinterest - Remote - $104k – $214k/yr

**Apply:** https://hotfix.jobs/jobs/be15cf1e-d631-44d2-9992-d575ecec9a12
**Canonical:** https://hotfix.jobs/jobs/be15cf1e-d631-44d2-9992-d575ecec9a12