Member of Technical Staff - Research Engineer
Research Engineer building evaluations, search systems, and training agentic ML models for tool integration in AI agents. Requires strong research execution, rapid prototyping, and collaboration to productionize ideas.
About the job
Responsibilities
- Build large evals with real tool calling data, measuring where models suck in long horizon tool execution
- Work on search problems for finding semantically similar tools and cached tool execution paths and plans
- Train large agentic harness systems to improve session accuracy with millions of real tool calls as baseline data
- SFT on agentic traces and RL models on top of agentic harness and app sandboxes
Requirements
- Independently execute against research goals
- Prototype and test experiments very quickly
- Work with product and engineering teams to take research ideas to production in days
- Strong typing/writing skills: write docs well and explain complex ideas clearly
- Build trust and admit what you don’t know
Skills
Machine Learning, Supervised Fine-Tuning, Sft, Reinforcement Learning, Rl, Search Algorithms, Evaluation Frameworks, Tool Calling, Agentic Systems, Prototyping, Experimentation
Similar jobs
ML Engineering jobs
Thinking Machines Lab
San Francisco, CA
Build and operate the engineering systems that support post-training research, including reinforcement learning infrastructure, sandboxed execution, data pipelines, and agent scaffolding. The role requires strong Python and systems engineering skills, project ownership, and a relevant bachelor’s degree or equivalent experience.
OpenAI
San Francisco, CA
Build research infrastructure and tooling that enables AI models to design silicon, including reinforcement learning environments, EDA integrations, evaluations, and experiment workflows. The role requires strong software engineering fundamentals and comfort working across research, tooling, and chip-design systems.
Rollstack
United StatesBuild production AI capabilities for automated slide and document generation, working across LLM applications, data analysis, and content generation. The role requires 3+ years in machine learning and NLP, advanced Python, and experience with LLM frameworks and production systems.
ClickUp
United States
Build and operate large-scale ranking and retrieval systems that power search relevance, including hybrid lexical/vector search, embeddings, query understanding, and permission-aware retrieval. Requires a bachelor's degree and 5+ years of ML engineering experience in ranking or information retrieval.
PathAI
Boston, MADevelop and deploy machine learning models for biomedical research and AI products, collaborating with scientific, engineering, and product teams. Requires an advanced quantitative degree, substantial ML experience, Python proficiency, and experience bringing models into production or research applications.