Software Engineer - Perception (Fallback Stack)
Build and deploy the ML-based perception system (3D detection, BEV, tracking, sensor fusion) for L4 autonomous trucks, owning models from architecture through onboard deployment and safety validation. Requires 5+ years in ML perception/robotics, strong Python/C++/PyTorch, and classical perception fundamentals.
About the job
Responsibilities
- Design, train, and deploy deep learning models for 3D object detection across LiDAR, camera, and radar sensors.
- Build multi-sensor fusion architectures that combine independent detection and classification streams.
- Characterize perception failure modes, build targeted evaluation sets, and hill-climb system-level metrics.
- Build and operate the data engine: shadow-mode comparison against production, automated data mining, and retraining loops.
- Contribute to camera- and LiDAR-based localization perception under degraded conditions.
- Take your work through the full safety validation pipeline before it operates on public roads.
- Collaborate daily with behavior/planning engineers, systems and safety engineers, and validation teams.
Requirements
- Bachelor's or Master's degree in Computer Science, Robotics, Electrical Engineering, or a related field.
- 5+ years of professional experience in ML-based perception, computer vision, or robotics.
- Strong proficiency in Python and C++.
- Hands-on experience training and deploying deep learning models in production (e.g., PyTorch).
- Solid grounding in classical perception: multi-object tracking, state estimation, and 3D geometry.
Nice-to-Haves
- Experience working in modern ML-based perception for autonomous systems.
- Experience with multi-sensor calibration and fusion.
- Experience optimizing models for onboard/embedded GPU inference.
- Background in safety-critical or automotive software development.
- Experience in a startup or fast-paced environment.
Compensation and Benefits
- Base salary range: $151,000 - $255,000 USD annually.
- Total compensation package may also include equity (options and/or restricted stock units), comprehensive health, dental, vision, life and disability insurance coverage, 401k retirement benefits with employer match, learning and wellness stipends, and paid time off.
- Actual base salary influenced by experience, credentials, education, skills, interview performance, and level/scope of position.
Skills
Python, C++, PyTorch, Machine Learning, Computer Vision, 3D Object Detection, Multi-Sensor Fusion, Multi-Object Tracking, State Estimation, 3D Geometry, Lidar, Camera, Radar, Deep Learning
Similar jobs
ML Engineering jobs
Applied Intuition
Sunnyvale, CA
Develop and deploy ML-first behavior prediction and planning systems for autonomous vehicles, forecasting the motion and interactions of road users. Requires a bachelor's degree, deep learning lifecycle expertise, and at least three years of production software experience with C++ or Python.
LangChain
New York, NYBuild and teach reliable AI agent systems through customer workshops, technical content, guidance, and reference implementations. The role requires strong Python and agent-development experience plus a background delivering customer-facing technical training.
Roboflow
San Francisco, CA
Build reinforcement-learning environments, evaluations, datasets, and scalable infrastructure for frontier AI capabilities. The role suits a high-agency generalist engineer with experience in agents, evaluations, or RL workflows and strong communication skills.
Beacon Biosignals
Boston, MADevelop and productionize machine- and deep-learning algorithms for biosignal and EEG data used in medical devices, clinical development, and diagnostics. The role requires 4+ years of industry experience, DSP and statistics expertise, PyTorch proficiency, and familiarity with regulated environments and production ML practices.
Pindrop
United States
Research Scientist II building and improving fraud risk models and scam detection systems using audio, behavioral, and metadata signals. Requires an advanced degree and 3+ years of applied ML experience with Python and modern ML frameworks.