Skip to content
AsteraAstera

Research Scientist: Hierarchical RL Agents

Conducts fundamental research on hierarchical RL agents, developing architectures for world modeling, planning, and ethologically constrained learning. Collaborates cross-functionally to translate brain-inspired principles into scalable AGI systems; requires PhD-level expertise in AI/ML and strong coding skills.

About the job

Core Responsibilities

  • Fundamental Research on Hierarchical World Model Learning from Experience: Develop and implement new architectures and learning/inference algorithms for hierarchical RL that supports hierarchical world modeling and hierarchical planning.
  • Ethologically constrained learning: Design tasks to evaluate the agent in ethologically constrained environments, and benchmark different agent designs. Design experiments to test hypotheses regarding high-level cognition, causal representations, sensory-motor integration, active inference, and unsupervised learning.
  • Cross-Disciplinary Collaboration: Work alongside neuroscientists and software engineers to translate abstract mathematical frameworks into scalable systems.
  • Contribute to Open Science: Help innovate new publication models that incentivize speedy dissemination, open source code releases, free open access, and impact measurements based on uptake.

Desired Qualifications

  • Technical Depth: Preferred: PhD in Computer Science, Electrical Engineering, Neuroscience, Physics, or a related quantitative field. Open to exceptional candidates with non-traditional educational histories.
  • Theoretical Rigor: Strong foundations in deep learning, graphical models, and information theory.
  • Coding Proficiency: Expert-level skills in deep learning frameworks (PyTorch/JAX), with a focus on clean, reproducible research code.
  • AGI Mindset: Demonstrated interest in the "big questions" of AI—robustness, generalization, and common-sense reasoning.
  • Curious About the Brain: Genuine passion for exploring the computational and architectural principles of the mammalian brain.
  • Startup DNA: Ability to thrive in a lean, fast-paced environment where you have high autonomy and a direct influence on research direction.

Skills

Hierarchical Rl, Reinforcement Learning, PyTorch, JAX, Deep Learning, Graphical Models, Information Theory, World Modeling, Active Inference, Unsupervised Learning

AI Digest

AI Digest

Remote

Research Scientist - Member of Technical Staff
$150k+/yrRemoteAI Research

Conduct research on long-horizon, multi-agent AI behavior by designing agent environments, analyzing large-scale data, and running experiments. The role requires strong research judgment, rapid execution, independence, and familiarity with current AI developments.

AI Digest

AI Digest

Remote

Engineer - Member of Technical Staff
$150k+/yrRemoteAI Research

Build, optimize, and evaluate long-running and multi-agent AI systems, along with tools for monitoring and analyzing their real-world behavior. The role requires software engineering experience with coding agents, strong independence, and familiarity with current AI developments.

Counsel Health

Counsel Health

New York, NY
Research Scientist
$165k+/yrHybrid5+ YOEAI Research

Research Scientist developing and evaluating health-focused AI models, large language models, and agentic systems for clinical applications. The role requires advanced research experience, strong coding skills, healthcare or clinical-data experience, and top-tier AI/ML publications.

Mercor

Mercor

San Francisco, CA

Research Engineer – Benchmarking
$130k+/yrOn-siteAI Research

Research Engineer focused on designing benchmarks, evaluation systems, rubrics, and failure-analysis workflows for frontier language models. The role requires strong applied AI research and coding experience, with expertise in model evaluation, data quality, and backend systems.

Okta

Okta

Toronto, Canada

AI Trainer
CA$124k+/yrHybridAI Research

Own and optimize an enterprise customer-support AI agent by improving prompts, conversational quality, guardrails, intent recognition, and performance. The role requires deep conversational AI experience, strong analytical skills, platform expertise, and strategic collaboration across support teams.