Machine Learning Engineer, Assistant Quality

Responsibilities

• Build and improve ML- and LLM-powered systems that raise the quality of Glean’s AI Assistant and autonomous agents across real user workflows.
• Design evaluation, benchmarking, and monitoring loops to measure assistant quality, model quality, and end-to-end system performance.
• Develop and iterate on signals, prompts, workflows, and model-driven logic that improve reasoning, planning, personalization, and task completion quality.
• Apply techniques such as RAG, semantic search, recommendation systems, post-training or reinforcement learning, and agent orchestration where they improve product outcomes.
• Partner with product, design, and engineering teammates to understand customer pain points and ship high-quality production systems quickly.
• Contribute to data and ML infrastructure supporting experimentation, offline and online evaluation, and continuous model improvement.

Requirements

• 2+ years of industry experience in machine learning, applied AI, or software engineering with significant ML ownership.
• Strong hands-on coding ability and a track record of shipping production systems, not just prototypes or research projects.
• Experience with one or more of: LLM applications, NLP, search, retrieval, recommendations, evaluation frameworks, agent systems, or personalization.
• Comfort working across modeling and product engineering, including experimentation, quality measurement, and production iteration.
• Proficiency with common ML tooling and strong software engineering fundamentals in Python, Go, Java, or C++.
• A pragmatic, product-minded approach to choosing sophisticated ML techniques versus simple, reliable systems.
• A proactive, low-ego working style and excitement about learning quickly in a high-velocity environment.

Compensation & Benefits

• Base salary range: $180,000–$205,000 annually.
• Compensation may also include variable compensation, equity, and benefits, depending on the role.
• Medical, vision, and dental coverage.
• Generous time-off policy and 401(k) contribution opportunity.
• Home office improvement stipend.
• Annual education and wellness stipends.
• Regular company events and healthy lunches daily.