Data Operations Manager, Human Data
Leads data strategy and operations for frontier AI research, including vendor partnerships, data pipelines, evaluation frameworks, and quality standards. Requires at least 3 years of operations, consulting, product, or program management experience and familiarity with AI training or LLMs.
About the job
Responsibilities
- Own and execute data strategy for research teams working across RLHF, safety, tool use, and agentic workflows.
- Drive vendor partnerships and build scalable frameworks for technical data collection.
- Design and implement operational systems that translate research requirements into high-quality data pipelines.
- Build evaluation frameworks and quality standards for training data used in state-of-the-art AI systems.
- Lead cross-functional initiatives to improve research velocity while maintaining rigorous quality standards.
- Identify risks, bottlenecks, and opportunities to improve efficiency across data operations.
- Partner with senior research leaders to align data operations with model development roadmaps and strategic priorities.
Requirements
- 3+ years of experience in operations, consulting, product management, or program management.
- Exceptional project management skills, with the ability to manage multiple complex projects simultaneously.
- Strong communication skills with technical and non-technical stakeholders.
- Familiarity with how large language models work or strong interest in AI training methodologies.
- Highly organized and comfortable navigating ambiguity.
- Experience with data analysis tools such as SQL, Python, Tableau, or spreadsheets.
- Ability to thrive in fast-paced research environments with shifting priorities.
- Passion for AI safety and the importance of high-quality data.
- Bachelor's degree or equivalent combination of education, training, and experience.
Nice-to-haves
- Experience with data collection, labeling, or annotation operations for AI/ML systems.
- Knowledge of RLHF, Constitutional AI, or human-in-the-loop workflows.
- Experience working with AI research teams or research-oriented organizations.
- Experience managing vendors or external contractors.
- Consulting experience translating complex requirements into deliverables.
- Track record of implementing process improvements or quality-control systems at scale.
Compensation
- Annual salary: $270,000–$365,000 USD.
Skills
SQL, Python, Tableau, Spreadsheets, LLMs, RLHF, Constitutional Ai, Data Pipelines, Data Annotation, Vendor Management, Quality Control Systems
Similar jobs
Data Analytics jobsThe first dedicated marketing analytics hire will build the data foundation, measurement frameworks, dashboards, and experimentation capabilities connecting acquisition, product usage, and revenue. Requires 5+ years in marketing, growth, product analytics, data science, or another quantitative discipline, plus deep SQL and modern data-stack experience.
Own growth and product analytics for activation, retention, expansion, and monetization, using experiments, SQL, AI automation, and product analytics tools. The role partners cross-functionally to turn insights into pricing improvements, product changes, and shipped growth initiatives.
Analyzes and improves enterprise marketing systems, campaign data, automation workflows, and experimentation programs. The role requires 5–10 years of marketing systems experience, hands-on Marketo and Salesforce expertise, strong reporting and stakeholder-consultation skills, and a bachelor's degree or equivalent experience.
Own product and customer analytics across financial product experiences, turning behavioral data and customer feedback into roadmap recommendations and business decisions. The role requires 4–8 years of analytics experience, advanced SQL, strong analytical judgment, and daily fluency with AI-powered tools.
Own fraud detection, payments operations, investigations, and risk strategy while leading cross-functional programs and launch assessments. The role requires 4+ years in payments, fraud, or risk operations, strong SQL and card-network expertise, and the ability to communicate decisions across technical and business teams.