Research, ML
ML Research Engineer trains foundational embedding models for web search, designs novel transformer architectures, creates datasets and evals, and beats state-of-the-art performance. Requires graduate-level ML expertise and ability to implement transformers in PyTorch.
About the job
Responsibilities
- Dream up novel transformer-based search architectures.
- Create large-scale datasets and dive deeply into the data.
- Create evals and beat internal state-of-the-art models.
- Pre-training: Train hundred billion parameter models.
- Fine-tuning: Build RLAIF pipelines for search.
- Implement novel architectures and improve search scores.
- Build evaluation systems to measure search quality advancements.
Requirements
- Graduate-level ML experience (or exceptionally strong undergrad).
- Ability to code a transformer from scratch in PyTorch.
- Passion for creating high-quality knowledge datasets and solving search problems.
Nice-to-Haves
Compensation/Benefits
- Premium healthcare (medical, dental, vision).
- Fertility benefits.
- Monthly wellness stipend.
Skills
PyTorch, Transformers, Machine Learning, Embeddings, Rlaif, Pre-Training, Fine-Tuning, Datasets, Evaluations, Rust
Similar jobs
AI Research jobs
AI Digest
Remote
Conduct research on long-horizon, multi-agent AI behavior by designing agent environments, analyzing large-scale data, and running experiments. The role requires strong research judgment, rapid execution, independence, and familiarity with current AI developments.
AI Digest
Remote
Build, optimize, and evaluate long-running and multi-agent AI systems, along with tools for monitoring and analyzing their real-world behavior. The role requires software engineering experience with coding agents, strong independence, and familiarity with current AI developments.
Counsel Health
New York, NYResearch Scientist developing and evaluating health-focused AI models, large language models, and agentic systems for clinical applications. The role requires advanced research experience, strong coding skills, healthcare or clinical-data experience, and top-tier AI/ML publications.
Mercor
San Francisco, CA
Research Engineer focused on designing benchmarks, evaluation systems, rubrics, and failure-analysis workflows for frontier language models. The role requires strong applied AI research and coding experience, with expertise in model evaluation, data quality, and backend systems.
Hightouch
United States
Develops experimental AI techniques and prototypes for agentic marketing applications, with emphasis on image and video generation. The role requires strong backend or probabilistic systems expertise, quantitative thinking, creativity with LLM applications, and product intuition.