AI Research Engineer
Conducts research on diffusion, vision-language, and vision-language-action models for autonomous construction robots. The role requires deep-learning R&D experience or advanced graduate training, strong multimodal AI expertise, scalable data workflows, and model optimization for edge deployment.
About the job
Responsibilities
- Research and innovate diffusion-based generative models for photorealistic wall-surface simulation, defect synthesis, and domain adaptation.
- Architect and train Vision-Language Models (VLMs) and Vision-Language Action Models (VLA) that connect textual work orders, CAD plans, and sensor data to pixel-level understanding.
- Lead auto-annotation pipelines using active learning, self-training, and synthetic data to scale to millions of frames and point clouds with minimal human effort.
- Optimize and compress models using INT8, LoRA, and distillation for deployment on Jetson-class edge devices under ROS 2.
- Own the full lifecycle from problem definition, literature review, and prototyping through offline/online evaluation and production hand-off to perception and controls teams.
- Publish internal technical reports and external conference papers.
- Mentor interns and junior engineers.
Requirements
- 3+ years of deep-learning R&D experience, or a PhD/Master's degree in computer science, electrical engineering, robotics, or a related field with a strong publication record.
- Demonstrated expertise in diffusion models, including DDPM, LDM, and ControlNet.
- Experience with multimodal transformers and VLMs, including CLIP, BLIP-2, LLaVA, or Flamingo.
- Proven success building large-scale data-centric AI workflows using active learning, pseudo-labeling, and weak supervision.
- Advanced proficiency in Python, PyTorch or JAX, experiment tracking, and scalable training with tools such as PyTorch Lightning, DeepSpeed, or Ray.
- Familiarity with edge-AI runtimes such as TensorRT and ONNX Runtime.
- Experience with CUDA and C++ performance tuning.
- Strong mathematical foundation in probability, information theory, and optimization.
- Ability to translate theory into production code.
Nice to Have
- Experience with synthetic data generation in Isaac Sim.
- Experience with robotics perception stacks, including ROS 2, Nav2, MoveIt 2, or Open3D.
Skills
Python, PyTorch, JAX, Diffusion Models, Vision-Language Models, Multimodal Transformers, Active Learning, Pseudo-Labeling, Weak Supervision, TensorRT, Onnx Runtime, CUDA, C++, Ros 2, Isaac Sim
Similar jobs
AI Research jobs
Improbable
Remote
Conduct applied research on AI agents, designing experiments and evaluation systems to improve reliability, context retention, and multi-step task completion. The role requires strong AI/ML research, engineering, experimental design, and communication skills.
AI Digest
Remote
Conduct research on long-horizon, multi-agent AI behavior by designing agent environments, analyzing large-scale data, and running experiments. The role requires strong research judgment, rapid execution, independence, and familiarity with current AI developments.
AI Digest
Remote
Build, optimize, and evaluate long-running and multi-agent AI systems, along with tools for monitoring and analyzing their real-world behavior. The role requires software engineering experience with coding agents, strong independence, and familiarity with current AI developments.
Vanta
Remote
Build Vanta’s organizational intelligence layer by shipping prototypes, internal tools, and AI agent workflows that make cross-source data useful to EPD, GTM, and other teams. The role requires recent hands-on LLM product work, independent problem scoping, and strong judgment around AI quality, reliability, cost, and latency.