Research Scientist - World-Action Foundation Model, Robotics
Conducts research on world-action foundation models for robotics and autonomous driving, focusing on 3D vision, multi-modal pretraining, and Gaussian splatting. Requires MSc/PhD in ML/CV, strong publication record, and expertise in Python/PyTorch.
About the job
Responsibilities
- Conduct research on pretraining world-action foundation model with various world modalities including vision and physics associated with ego actions, serving the purpose for both robot action and simulation world generation.
- Dive into relevant topics such as vision-physics modality association, feed-forward Gaussian splatting, world foundation model, human data incorporation, language modality, spatial reasoning, deformable object modeling and simulation.
- Explore related topics including 3D/world-action foundation model, multi-modal pretraining, feed-forward Gaussian splatting, world foundation model with applications to autonomous driving, and fundamental topics on 3D vision and generation.
- Work closely with other Research Scientists and interns on research publications for submission to top-tier conferences.
- Collaborate with Research Engineers and engineering teams to test and deploy algorithms to our autonomy and simulation products.
Requirements
- Strong research record in the fields of 3D vision, reconstruction and generation for robotics and autonomous systems, with publications in top-tier conferences or journals in the fields of computer vision, machine learning, and robotics.
- MSc or PhD in machine learning and computer vision with autonomy and robotics applications or closely-related fields.
- Passion for next-generation, scalable autonomy and robotics for real-world systems.
- Strong research skills and the ability to work both independently and collaboratively on projects.
- Technical experience in: Python, PyTorch, computer vision, robotics systems, and distributed machine learning model training.
Nice to Have
- Hands-on experience in at least one of the following fields:
- 3D foundation model and pretraining
- Multi-modal foundation model
- Feed-forward Gaussian splatting and reconstruction
- World foundation model and generation
- 3D/multi-view end-to-end models for autonomous driving or robotics
- Human data processing and incorporation
Compensation
- Base salary range: $126,000 - $423,000 USD annually.
- Equity, comprehensive health/dental/vision/life/disability insurance, 401k with employer match, learning/wellness stipends, paid time off.
Skills
Python, PyTorch, Computer Vision, 3D Vision, Machine Learning, Robotics, Distributed Training, Gaussian Splatting, Multi-Modal Models, Foundation Models
Similar jobs
AI Research jobs
Applied Intuition
Sunnyvale, CA
Research Engineer developing and deploying machine-learning algorithms for autonomous driving and robotics systems. The role targets recent MS or PhD graduates with experience in areas such as foundation models, diffusion policies, reinforcement learning, computer vision, and robotics.
GrayMatter Robotics
Los Angeles, CA
Conduct research and develop foundation models for robotic manipulation and high-precision manufacturing, taking projects from data curation through deployment on industrial robots. The role requires current PhD study, strong Python and deep learning expertise, robotics simulation experience, and research in foundation models.
OnePay
United States
AI Research Intern researching agentic AI applications for customer-facing products and developing working prototypes. The role requires current pursuit of a technical bachelor's degree, prior software engineering or substantial project experience, and interest in LLMs or generative AI.
Immuta
College Park, MD
Summer 2027 internship applying computer science, mathematics, statistics, and machine learning research to practical product capabilities. The intern will prototype, evaluate, and communicate solutions involving data privacy, security, governance, algorithms, and text analytics.
Fireworks AI
San Mateo, CAConduct foundational research on LLMs and multimodal systems, designing architectures and training methods and helping move prototypes into production. The role targets PhD researchers graduating by December 2026 with strong machine-learning research and programming experience.