# Senior Staff Machine Learning Engineer - Perception

**Company:** [Zoox](https://hotfix.jobs/companies/zoox)
**Location:** Boston, MA
**Role:** ML Engineering
**Salary:** $277k – $389k/yr
**Skills:** Deep Learning, Computer Vision, Python, C++, Machine Learning Pipelines, PyTorch, TensorFlow, Lidar, Sensor Fusion, Point Clouds, Generative AI, Convolutional Neural Networks
**Posted:** 2024-11-12

> Leads development of ML algorithms for robot perception, including scene understanding, tracking, segmentation, and multi-modal foundation models using sensor data. Requires deep expertise in deep learning, computer vision, and production ML pipelines, collaborating across autonomy teams.

## Job Description

## Responsibilities
- Develop new algorithms to understand the scene around the robot, and how that scene would evolve through time
- Build multi-modal foundation models for on-vehicle and offline applications
- Develop new algorithms to apply generative AI to simulation to improve the realism of our offline validation systems
- Leverage our large-scale machine learning infrastructure to discover new solutions and push the boundaries of the field
- Provide technical mentorship to the broader group of ML developers
- Collaborate with engineers on Prediction, Planning, and Simulation to solve the overall Autonomous Driving problem in complex urban environments

## Qualifications
- BS, MS, or PhD degree in computer science or related field
- Experience with training and deploying Deep Learning models on sensor data
- Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
- Experience with modern computer vision techniques
- Strong mathematical skills and understanding of probabilistic techniques
- Fluency in C++ or Fluency in Python with a basic understanding of C++
- Extensive experience with programming and algorithm design
- Strong mathematics skills

## Bonus Qualifications
- Publications in your field (CVPR, ICCV, RSS, ICRA preferred)
- Experience with autonomous robots
- Experience with realtime sensor fusion (e.g. LiDAR, camera, radar)
- Experience with novel pipelines and architectures for convolutional neural nets
- Experience with 3D data and representations (pointclouds, meshes, etc.)

## Similar roles

- [Staff / Senior Staff Software Engineer - Learned Trajectory Machine Learning Engineer](https://hotfix.jobs/jobs/9449191b-9b08-4799-997f-7a53378184e1) - Zoox - Foster City, CA - $277k – $407k/yr
- [Staff Machine Learning Engineer, Underwriting and Credit](https://hotfix.jobs/jobs/b61761e2-2aef-46fd-888b-9f738b8c47f2) - Square - Remote - $277k – $415k/yr
- [Staff Applied Machine Learning Engineer - Fraud & Abuse](https://hotfix.jobs/jobs/c8ea2c50-bd8e-410a-9116-6abf45a49a47) - Square - San Francisco, CA - $277k – $415k/yr
- [Staff Applied Machine Learning Engineer](https://hotfix.jobs/jobs/e1528eb9-6d81-4ecf-b9d5-ebc31ee66a75) - Square - Remote - $277k – $415k/yr
- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/522da530-b698-444d-80e5-307cd4eeafe0) - Otter - Mountain View, CA - $278k – $330k/yr

**Apply:** https://hotfix.jobs/jobs/ed07dc78-49c2-4be4-89e7-c698011ce10b
**Canonical:** https://hotfix.jobs/jobs/ed07dc78-49c2-4be4-89e7-c698011ce10b