Skip to content
Dynamo AIDynamo AISan Francisco, CA

Senior Applied ML Research Engineer, Agentic Security

Designs threat models and experiments for agentic AI security risks, builds prototypes with fine-tuned models and analysis tools, and turns research into scalable product defenses. Requires MS/PhD in CS/ML, production coding skills, and security mindset.

Salary not listed
RemoteML Engineering

About the role

Responsibilities

  • Define and validate threat models for agentic systems, identifying which tool characteristics must co-exist to enable data exfiltration and malicious state change, and how to break those combinations
  • Design and run experiments: create synthetic environments like file systems and tools, create task distributions that have attack paths and apply different attack strategies
  • Break (manually and using optimization algorithms such as RL) agentic systems
  • Design and improve static and dynamic analysis methods that automatically map tool capabilities to risk across diverse tool ecosystems, and make those methods scale
  • Turn research insights into product-facing capabilities: risk classification, automated guardrail generation, and quantitative threat measurement
  • Build measurement tools: eval harnesses, monitoring, dashboards, and feedback loops that quantify security outcomes
  • Build capability and regression evals
  • Optimize systems for real-world constraints (latency, cost, reliability) without losing scientific rigor

Requirements

  • MS or PhD in CS/ML (or equivalent research experience) and enjoy working under uncertainty
  • Fine-tuned and evaluated models in practice and can reason about data quality, overfitting, evals, and deployment constraints
  • Write strong production code, comfortable owning the infrastructure that makes agentic evals run end-to-end; care about reproducibility and instrumentation
  • Motivated by security problems and enjoy thinking like both builder and attacker
  • Reason about how capabilities combine into risk: not just individual vulnerabilities, but system-level attack surfaces across tool ecosystems
  • Communicate clearly, iterate fast, and can hold a technical narrative from "hypothesis" to "shipped"

Compensation & Benefits

  • Competitive salary + equity
  • Remote-friendly, with preference for candidates based in Amsterdam, Paris, Poland, New York, or San Francisco
  • Fully funded team retreats every 8 weeks
  • Health insurance allowance for you and your dependents
  • Wellbeing, learning, and home office allowances

Skills

Machine LearningFine-TuningReinforcement LearningStatic AnalysisDynamic AnalysisPythonEvaluation FrameworksDashboardsMonitoringAgentic Systems

Similar roles

ML Engineering jobs
Scale AI

Senior Machine Learning Engineer, Agent Oversight

Scale AISan Francisco, CA +1

Senior ML Engineer building observability, evaluation frameworks, and improvement loops for production agentic AI systems. Requires 5+ years production ML/LLM experience, strong grounding in agent design or evaluation, and hands-on work taking systems from prototype to scale.

216k – 270k/yr
On-site5+ YOEML Engineering
Scale AI

Senior Software Engineer, Agent Oversight

Scale AISan Francisco, CA +1

Build platform infrastructure for observing, evaluating, and improving production AI agents at scale. Requires 4+ years software engineering experience with ML/LLM systems, strong backend/distributed systems skills, and collaboration with ML engineers.

216k – 270k/yr
On-site5+ YOEML Engineering
Ambient.ai

Senior Software Engineer, AI Infrastructure

Ambient.aiRedwood City, CA

Build and optimize scalable AI infrastructure for real-time inference, evaluation, and continuous improvement of LLMs, LVMs, computer vision, and multimodal models on large-scale video data. Requires 4+ years production ML systems experience, strong Python skills, and expertise in inference optimization and model serving.

168k – 205k/yr
Hybrid4+ YOEML Engineering
SpotOn

Senior Software Engineer

SpotOnChicago, IL +3

Senior AI Engineer building agentic workflows and orchestration layers to automate manual business processes for operations, sales, and customer support teams. Requires 7+ years software engineering experience, production LLM/agent expertise, and strong Python/TypeScript skills.

160k – 190k/yr
Hybrid7+ YOEML Engineering
Snowflake

Senior AI Engineer, Enterprise

SnowflakeMenlo Park, CA

Senior AI Engineer building scalable backend services, distributed systems, and reusable AI platform components (agent frameworks, evaluation pipelines, SDKs) that power Snowflake's internal agentic applications for GTM teams. Requires 5+ years software engineering experience, strong Python/FastAPI skills, and production LLM experience.

156k – 224k/yr
On-site5+ YOEML Engineering