Research Engineering Lead
Leads hands-on research and engineering to improve frontier language models for AI software engineering, owning experiments, evaluation, training, and optimization end to end. The role also mentors researchers and engineers and partners across research, product, and infrastructure teams.
About the job
Responsibilities
- Design and execute experiments grounded in real coding and product use cases.
- Define, track, and optimize product-centric LLM performance metrics.
- Partner with engineering leads to hire and develop a world-class team.
- Own training pipelines, distillation workflows, and synthetic data generation systems.
- Work closely with infrastructure and product engineers to scale and ship model improvements.
- Build ensembles of LLMs into products.
Requirements
- Experience leading or contributing to cutting-edge LLM research at top AI labs.
- Experience fine-tuning large-scale transformer models on code, natural language, and multimodal datasets.
- Experience developing state-of-the-art models for code generation.
- Strong experimental design and evaluation skills.
- Natural leadership ability and a focus on building high-performing technical teams.
- Experience mentoring researchers and engineers and leading collaborative projects across research, engineering, and product teams.
- English proficiency.
Nice to Have
- Publications at top ML/AI conferences on LLMs, code intelligence, or agentic reasoning.
Technology
- React
- Golang
- Rust
- Cloudflare
- Google Cloud Run
- AWS
- Terraform
- CI/CD pipelines
- Observability
- Infrastructure as code
Skills
LLMs, Transformer Models, Model Fine-Tuning, Code Generation, Multimodal Models, Model Alignment, Llm Evaluation, Training Pipelines, Knowledge Distillation, Synthetic Data Generation, React, Go, Rust, AWS, Terraform
Similar jobs
AI Research jobsBuild Vanta’s organizational intelligence layer by shipping prototypes, internal tools, and AI agent workflows that make cross-source data useful to EPD, GTM, and other teams. The role requires recent hands-on LLM product work, independent problem scoping, and strong judgment around AI quality, reliability, cost, and latency.
Conduct applied research on AI agents, designing experiments and evaluation systems to improve reliability, context retention, and multi-step task completion. The role requires strong AI/ML research, engineering, experimental design, and communication skills.
Conduct research on long-horizon, multi-agent AI behavior by designing agent environments, analyzing large-scale data, and running experiments. The role requires strong research judgment, rapid execution, independence, and familiarity with current AI developments.
Build, optimize, and evaluate long-running and multi-agent AI systems, along with tools for monitoring and analyzing their real-world behavior. The role requires software engineering experience with coding agents, strong independence, and familiarity with current AI developments.