Machine Learning Engineer - Robot Perception
Develops and deploys ML-based perception algorithms for robot object detection, pose estimation, tracking, and scene understanding. Integrates sensor fusion from cameras, LiDAR, IMUs; requires MS/PhD in ML/CS/robotics, expertise in computer vision, PyTorch/TensorFlow, and real-world robotics hardware.
About the job
Responsibilities
- Develop, train, and deploy ML-based perception algorithms for object detection, pose estimation, tracking, and scene understanding.
- Integrate sensor fusion techniques using cameras, depth sensors, IMUs, and tactile feedback.
- Optimize real-time perception pipelines for low-latency and robust performance in dynamic environments.
- Work closely with hardware engineers to design sensor configurations and optimize perception models for onboard deployment.
- Contribute to broader AI and autonomy stack, ensuring seamless integration with reasoning, manipulation, planning and control.
- Collaborate across disciplines to ensure seamless integration of ML models and provide technical mentorship to junior engineers.
Qualifications
Must-have:
- MS or PhD in machine learning, computer science, robotics, or a related field.
- Strong background in computer vision, deep learning, and sensor fusion.
- Proficiency in Python and C++, with experience in frameworks like PyTorch, TensorFlow, OpenCV, and ROS.
- Hands-on experience with real-world robotics perception systems (e.g., SLAM, 3D reconstruction, multimodal perception).
- Experience working with hardware, including setting up and calibrating cameras, LiDAR, and other sensors.
- Experience with data collection, preprocessing, and management in the context of training ML models.
- Self-starter attitude with strong ability to identify problems, prioritize them, then plan and execute working solutions.
- Enthusiasm for working in a fast paced startup environment and eagerness to support the team on a variety of topics.
Nice-to-have:
- Familiarity with robotic simulation environments (e.g., Gazebo, MuJoCo) and experience in sim-to-real transfer.
- Experience in developing models that can handle noisy, incomplete, or sparse data.
- Deployment of ML models to edge devices for real-time inference (e.g., NVIDIA Jetson).
- Accelerating ML training processes using GPU, TPU, or other HW accelerators.
- General knowledge of robotics principles, including kinematics, dynamics, and control.
Skills
PyTorch, TensorFlow, Opencv, ROS, Python, C++, Computer Vision, Deep Learning, Sensor Fusion, Slam, Lidar, Nvidia Jetson, Gazebo, Mujoco
Similar jobs
ML Engineering jobs
Thinking Machines Lab
San Francisco, CA
Build and operate the engineering systems that support post-training research, including reinforcement learning infrastructure, sandboxed execution, data pipelines, and agent scaffolding. The role requires strong Python and systems engineering skills, project ownership, and a relevant bachelor’s degree or equivalent experience.
OpenAI
San Francisco, CA
Build research infrastructure and tooling that enables AI models to design silicon, including reinforcement learning environments, EDA integrations, evaluations, and experiment workflows. The role requires strong software engineering fundamentals and comfort working across research, tooling, and chip-design systems.
Rollstack
United StatesBuild production AI capabilities for automated slide and document generation, working across LLM applications, data analysis, and content generation. The role requires 3+ years in machine learning and NLP, advanced Python, and experience with LLM frameworks and production systems.
ClickUp
United States
Build and operate large-scale ranking and retrieval systems that power search relevance, including hybrid lexical/vector search, embeddings, query understanding, and permission-aware retrieval. Requires a bachelor's degree and 5+ years of ML engineering experience in ranking or information retrieval.
PathAI
Boston, MADevelop and deploy machine learning models for biomedical research and AI products, collaborating with scientific, engineering, and product teams. Requires an advanced quantitative degree, substantial ML experience, Python proficiency, and experience bringing models into production or research applications.