Senior Staff Machine Learning Engineer - Perception
Leads development of ML algorithms for robot perception, including scene understanding, tracking, segmentation, and multi-modal foundation models using sensor data. Requires deep expertise in deep learning, computer vision, and production ML pipelines, collaborating across autonomy teams.
About the job
Responsibilities
- Develop new algorithms to understand the scene around the robot, and how that scene would evolve through time
- Build multi-modal foundation models for on-vehicle and offline applications
- Develop new algorithms to apply generative AI to simulation to improve the realism of our offline validation systems
- Leverage our large-scale machine learning infrastructure to discover new solutions and push the boundaries of the field
- Provide technical mentorship to the broader group of ML developers
- Collaborate with engineers on Prediction, Planning, and Simulation to solve the overall Autonomous Driving problem in complex urban environments
Qualifications
- BS, MS, or PhD degree in computer science or related field
- Experience with training and deploying Deep Learning models on sensor data
- Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
- Experience with modern computer vision techniques
- Strong mathematical skills and understanding of probabilistic techniques
- Fluency in C++ or Fluency in Python with a basic understanding of C++
- Extensive experience with programming and algorithm design
- Strong mathematics skills
Bonus Qualifications
- Publications in your field (CVPR, ICCV, RSS, ICRA preferred)
- Experience with autonomous robots
- Experience with realtime sensor fusion (e.g. LiDAR, camera, radar)
- Experience with novel pipelines and architectures for convolutional neural nets
- Experience with 3D data and representations (pointclouds, meshes, etc.)
Skills
Deep Learning, Computer Vision, Python, C++, Machine Learning Pipelines, PyTorch, TensorFlow, Lidar, Sensor Fusion, Point Clouds, Generative AI, Convolutional Neural Networks
Similar jobs
ML Engineering jobs
Square
San Francisco, CA
Build and operate production machine learning systems for ranking, retrieval, recommendations, personalization, and customer intelligence. The role requires 12+ years of production software and ML experience, strong expertise in intelligent systems, and sound judgment around trustworthy customer-impacting signals.
United States
Leads the technical direction and development of large-scale, GenAI-powered recommendation and feed-ranking systems. Requires 10+ years of industry experience in relevance-driven products, deep expertise in machine learning and recommendations, and strong organizational influence and mentoring skills.
United States
Leads technical strategy for Reddit’s Ads ML Platform, improving feature development, training-data generation, experimentation, and the path to production ML serving. The role requires 8+ years in infrastructure or distributed systems, production ML platform experience, and strong cross-team technical leadership.
Garner Health
New York, NY
Leads the reliability, architecture, deployment automation, and monitoring of production machine learning systems. Requires 7+ years of software engineering experience, deep MLOps platform expertise, and strong Kubernetes, cloud, infrastructure-as-code, and observability fundamentals.
Garner Health
New York, NY
Leads end-to-end development of production algorithmic systems for healthcare, spanning machine learning, optimization, and LLM applications. The player-coach role requires 6+ years of industry experience, strong problem-solving and metrics judgment, and technical leadership of a small team.