# Member of Technical Staff, Perception

**Company:** [Xdof](https://hotfix.jobs/companies/xdof)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Experience:** 5+ years
**Skills:** C++, Python, ROS, Ros2, TensorRT, CUDA, Slam, Orb-Slam, Vins-Mono, Fastlio, Mediapipe, Mano, Openpose, Smplify, Jetson
**Posted:** 2026-06-17

> Perception engineer building robot training data pipelines: hand/body pose estimation, multi-camera calibration, SLAM, perception model training, and TensorRT/CUDA deployment on embedded platforms.

## Job Description

## Core Responsibilities

### Human Pose Estimation
- Design and optimize hand pose estimation pipelines supporting accurate joint angle extraction from teleoperation data collection
- Build full-body pose estimation systems for motion capture and teleoperation action annotation ground truth generation
- Research and apply vision-based pose estimation methods (markerless) to reduce data collection costs
- Fuse pose estimation outputs with robot joint angle data to generate consistent training annotations

### Robot Perception & Calibration
- Design and maintain intrinsic/extrinsic calibration pipelines for multi-camera arrays (factory calibration + online recalibration)
- Build visual SLAM / V-SLAM systems supporting real-time localization and scene reconstruction on data collection platforms
- Implement hand-eye calibration between cameras and robot end-effectors
- Develop temporal alignment solutions across multimodal sensors (cameras, IMU, data gloves, force sensors)

### Perception Model Training & Deployment
- Train and iterate on perception models including object detection, instance segmentation, and 6DoF pose estimation
- Optimize model inference using TensorRT / CUDA for real-time performance on robot embedded platforms
- Write custom CUDA kernels for low-level acceleration of perception tasks
- Design evaluation metric frameworks for perception models; continuously track the relationship between model performance and data quality

### End-to-End Loop from Data Collection to Model Delivery
- Contribute to the design of automated annotation pipelines that convert sensor data into structured training labels
- Build Auto QA modules to filter low-quality data including anomalous frames, failed demonstrations, and sensor dropouts
- Collaborate with ML engineers and data infrastructure teams to ensure perception output formats meet downstream VLA model training requirements
- Establish feedback mechanisms linking perception accuracy to model training outcomes, continuously improving annotation quality

## Requirements

### Must-Have
- 5+ years of industry experience in robot perception or computer vision
- Strong 3D vision fundamentals: stereo and structured-light camera principles, 3D reconstruction
- Proficiency with SLAM frameworks (ORB-SLAM, VINS-Mono, FastLIO, etc.) or V-SLAM system development experience
- Hands-on engineering experience with human pose estimation: hand joints (MediaPipe, MANO) or full-body pose (OpenPose, SMPLify, etc.)
- Proficient in deep learning training frameworks for perception model training, tuning, and evaluation
- TensorRT deployment experience with real-time inference optimization on embedded platforms (Jetson, Horizon, etc.)
- CUDA programming fundamentals; ability to write or debug custom kernels
- Proficient in C++ and Python with ROS / ROS2 development experience
- Proficient with AI coding agents

### Nice to Have
- Engineering experience with 6DoF object pose estimation (FoundPose, FoundationPose, GDR-Net, etc.)
- Familiarity with 3D Gaussian Splatting or NeRF for scene reconstruction or data augmentation
- Experience with robot manipulation or teleoperation systems
- End-to-end development experience with automated annotation pipelines or ground truth generation systems
- Published research in perception, pose estimation, or robotics

## What We Offer
- Direct involvement in the most critical technical challenge in embodied intelligence: producing high-quality robot training data
- An environment working alongside top-tier robotics engineers and ML researchers
- Proprietary hardware platforms (humanoid robots, camera arrays, data gloves)
- A fast-paced, high-autonomy 0→1 work environment

## Similar roles

- [Member of Technical Staff](https://hotfix.jobs/jobs/dd7c8bc4-741a-45d5-91a8-e6b1c4ad67e0) - xAI - Palo Alto, CA - $180k – $440k/yr
- [Staff Software Engineer, AI & App Experience](https://hotfix.jobs/jobs/78128221-8199-41cd-9c63-502d3f61d603) - Chime - New York, NY - $223k – $308k/yr
- [Staff + Senior Software Engineer, Cloud Inference Launch Engineering](https://hotfix.jobs/jobs/18b08a6a-5359-4836-b72e-c641fa718b04) - Anthropic - San Francisco, CA - $320k – $485k/yr
- [Senior Staff Software Engineer, Legal Automation](https://hotfix.jobs/jobs/7870d3e1-ebec-4f7b-9ae5-c62926a06d6e) - Coinbase - Remote - $254k – $299k/yr
- [Staff Machine Learning Engineer, Computer Vision](https://hotfix.jobs/jobs/2969c5c0-8479-43bb-b9b6-f8df93b528d7) - Pinterest - San Francisco, CA - $189k – $390k/yr

**Apply:** https://hotfix.jobs/jobs/88e623bc-cc02-4b61-8faf-8193300f5ee8
**Canonical:** https://hotfix.jobs/jobs/88e623bc-cc02-4b61-8faf-8193300f5ee8