Senior/Staff Machine Learning Engineer - Perception Offline Driving Intelligence

Responsibilities

• Lead the development of multimodal large language models that enhance our robotaxis' understanding of complex urban environments
• Design effective model architectures and sophisticated training techniques, leveraging all the inputs from our sensor stack and the overall large scale data we have at Zoox.
• Drive end-to-end ML solutions from research to production, utilizing Zoox's extensive data pipelines and infrastructure to improve autonomous driving capabilities
• Collaborate with perception, planning, safety, and systems teams to integrate your models into the vehicle's decision-making pipeline
• Validate and optimize your solutions using real-world driving scenarios, directly contributing to the safety and reliability of Zoox's autonomous system

Qualifications

• MS or PhD in Computer Science, Machine Learning, or related technical field
• Demonstrated experience training and deploying large language models (LLMs)
• Experience building and maintaining ML training pipelines, including data preprocessing, model training, and evaluation
• Proficiency in Python and ML libraries (PyTorch, NumPy) demonstrated through professional or research projects
• Experience training with large scale datasets (e.g. tens of millions of videos)

Bonus Qualifications

• Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
• Experience with autonomous robotics systems