Develops evaluation methods, alignment techniques, and adversarial testing for large language models to ensure safety and alignment with human values. Requires PhD in ML/CS, production code skills, GPU experience, and transformers/RL expertise.
225k – 400k/yr
On-siteAI Research
About the role
Responsibilities
Develop and implement novel evaluation methodologies and metrics to assess the safety and alignment of large language models.
Research and develop cutting-edge techniques for model alignment, value learning, and interpretability.
Conduct adversarial testing to proactively uncover potential vulnerabilities and failure modes in our models.
Analyze and mitigate biases, toxicity, and other harmful behaviors in large language models through techniques like reinforcement learning from human feedback (RLHF) and fine-tuning.
Collaborate with engineering and product teams to translate safety research into practical, scalable solutions and best practices.
Stay abreast of the latest advancements in AI safety research and contribute to the academic community through publications and presentations.
Requirements
Hold a PhD (or equivalent experience) in a relevant field such as Computer Science, Machine Learning, or a related discipline.
Write clear and clean production-facing and training code.
Experience working with GPUs (training, serving, debugging).
Experience with data pipelines and data infrastructure.
Strong understanding of modern machine learning techniques, particularly transformers and reinforcement learning, with a focus on their safety implications.
Passionate about the responsible development of AI and dedicated to solving complex safety challenges.
Nice to Have
Experience with product experimentation and A/B testing.
Experience training large models in a distributed setting.
Familiarity with ML deployment and orchestration (Kubernetes, Docker, cloud).
Experience with explainable AI (XAI) and interpretability techniques.
Research in AI safety, alignment, ethics, or a related area.
Knowledge of the broader societal and ethical implications of AI, including policy and governance.
Publications in relevant academic journals or conferences in the field of machine learning.
Skills
PyTorchTransformersReinforcement LearningRLHFGpusData PipelinesInterpretabilityKubernetesDockerExplainable Ai
Conducts ML research to advance LLMs and audio models for real-time voice AI agents, focusing on reasoning, latency, and conversational quality. Prototypes models, designs evaluations, and bridges research to production systems requiring strong PyTorch expertise and experimental mindset.
225k – 400k/yr
On-siteAI Research
Applied AI Scientist, Small Language Model and AI Training
PostmanSan Francisco, CA
Leads R&D on small language models and AI training, developing efficient architectures, optimizing performance, and ensuring safety. Collaborates with research, engineering, and product teams using Python, PyTorch, TensorFlow, or JAX.
219k – 276k/yr
HybridAI Research
Research Scientist, Safety Post Training
Scale AISan Francisco, CA +1
Develop and apply post-training methods and interpretability techniques to improve safety and understanding of frontier AI systems. Requires 3+ years of ML experience, expertise in RL techniques like RLHF and DPO, and published research in generative AI.
216k – 270k/yr
Hybrid3+ YOEAI Research
Post-Training Research Scientist
BasetenSan Francisco, CA
Conducts research on post-training methodologies and performant inference for AI models, balancing pure research with applied work for production systems. Requires PhD in ML with top publications and ability to design rigorous experiments at scale.
210k – 285k/yr
HybridAI Research
Machine Learning Scientist (All Levels)
AbridgeSan Francisco, CA +2
Conducts machine learning research in medical NLP for conversation summarization, evidence extraction, and outcome prediction. Publishes at top AI conferences, deploys models to production, and requires MS/PhD plus strong PyTorch/TensorFlow experience.