Senior / Staff Machine Learning Engineer - Perception Attributes
Develops and maintains behavioral models for road users (vehicles, pedestrians, cyclists) in autonomous driving perception stack. Requires MS/PhD, 7+ years experience, deep learning expertise, Python fluency, and production ML pipelines.
About the job
Responsibilities
- Lead the development of sophisticated behavioral models for vehicles, pedestrians, and cyclists as a key member of the Attributes team within Zoox's Perception department.
- Create and maintain perception attribute models that generate essential signals, enabling our autonomous vehicles to understand and predict the behavior of various road users.
- Collaborate closely with Prediction and Planning teams to optimize your models' outputs, directly influencing how our autonomous vehicles make real-time driving decisions.
- Work with data labeling and ontology teams on data labeling and ontology definitions of the road users in different attributes and generate auto-labeling or data mining strategies for different attributes.
Qualifications
- MS/PhD in computer science or related fields with a minimum of 7 years of relevant experience
- Experience with training and deploying Deep Learning models
- Experience with knowledge distillations from large foundation models
- Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
- Fluency programming in Python and extensive experience with algorithm design
- Strong mathematics skills
Bonus Qualifications
- Familiarity of VLMs/VLAs/ViTs
- Experience with large model distillation in a production environment
- Familiarity with C++
Skills
Deep Learning, Machine Learning Pipelines, Python, Knowledge Distillation, Vision Language Models, Vlms, Vision Transformers, Vits, C++, Data Labeling, Auto-Labeling, Dataset Creation
Similar jobs
ML Engineering jobsLeads the roadmap and technical vision for Snowflake Feature Store, building reliable, high-performance machine learning platform capabilities and supporting technical execution across partner teams. Requires 10+ years of experience with data-serving infrastructure or ML platforms, plus Java and Python expertise.
Senior Staff ML Engineer fine-tunes and optimizes state-of-the-art LLMs for Airbnb's customer support AI products, including AI assistants and autonomous agents. Partners cross-functionally to productionize models at scale. Requires PhD and 10+ years experience with PyTorch.
Leads the design, implementation, integration, and field validation of tactical autonomy and multi-agent coordination capabilities for unmanned platforms. Requires 7+ years of relevant experience, production C++, technical leadership, and eligibility for a U.S. Secret clearance.
Staff Machine Learning Engineer building and operating production ML systems for causal marketing measurement, optimization, and planning. The role requires deep statistical and machine learning expertise, production programming experience, cross-functional collaboration, and technical mentorship.
Staff engineer responsible for designing and scaling the infrastructure, execution environments, verifiers, and tooling used to train and evaluate AI agents. Requires 8+ years of software engineering experience, strong Python and distributed-systems expertise, and familiarity with sandboxing, high-throughput systems, and LLM workflows.