Research Staff, LLMs

What You'll Do

• Brainstorming and collaborating with other members of the Research Staff to define new LLM research initiatives
• Broad surveying of literature, evaluating, classifying, and distilling current methods
• Designing and carrying out experimental programs for LLMs
• Driving transformer (LLM) training jobs successfully on distributed compute infrastructure and deploying new models into production
• Documenting and presenting results and complex technical concepts clearly for a target audience
• Staying up to date with the latest advances in deep learning and LLMs, with a particular eye towards their implications and applications within our products

It's Important to Us That You Have

• 3+ years of experience in applied deep learning research, with a solid understanding toward the applications and implications of different neural network types, architectures, and loss mechanism
• Proven experience working with large language models (LLMs) - including experience with data curation, distributed large-scale training, optimization of transformer architecture, and RL Learning
• Strong experience coding in Python and working with Pytorch
• Experience with various transformer architectures (auto-regressive, sequence-to-sequence.etc)
• Experience with distributed computing and large-scale data processing
• Prior experience in conducting experimental programs and using results to optimize models

It Would Be Great if You Had

• Deep understanding of transformers, causal LMs, and their underlying architecture
• Understanding of distributed training and distributed inference schemes for LLMs
• Familiarity with RLHF labeling and training pipelines
• Up-to-date knowledge of recent LLM techniques and developments
• Published papers in Deep Learning Research, particularly related to LLMs and deep neural networks

Benefits & Perks

• Medical, dental, vision benefits
• Annual wellness stipend
• Mental health support
• Unlimited PTO
• Generous paid parental leave
• Flexible schedule
• 401(k) plan with company match
• Learning / Education stipend