Scale AISan Francisco, CALead Scale’s Policy Research Lab, setting strategy and managing research on AI safety, benchmarks, and frontier risk evaluations while collaborating with government institutes and academia. Requires 6+ years experience, strong technical/policy background, and proven team leadership.
Lead AI evaluation for Figma's AI-powered products. Define quality metrics, build human + automated eval frameworks (rubrics, golden datasets, LLM-as-judge), manage a small team, and deliver decision-ready insights to Product, Design, and Engineering stakeholders.
Lead AI research defining the agenda for trustworthy agentic systems, memory, retrieval, and evaluation frameworks. PhD required with 5+ years focused on LLMs/agents and a strong publication record; work ships directly to production for high-stakes financial users.
Lead applied AI research practice delivering client outcomes through benchmarking, data strategy, and RL environments. Drive revenue impact, scope engagements, and lead cross-functional teams of researchers and engineers.
Lead Protege's DataLab research organization, defining strategy for AI training data quality, evaluation systems, and marketplace optimization while managing researchers and partnering with Product, Engineering, and GTM.
As a Principal Applied Scientist, you will define the technical direction for offer optimization and conversion modeling systems, working across teams to integrate models and optimization systems. This role involves structuring ambiguous problems, designing solutions, and providing technical oversight to ensure a coherent long-term vision.