Skip to content
DrataDrataSan Francisco, CA

Senior AI Engineer, Agent Harness

Senior AI Engineer to design, build, and scale agentic AI systems using LLMs for compliance automation. Own end-to-end development of production LLM + retrieval + agent workflows with focus on responsible AI.

167k – 226k/yr
Hybrid5+ YOEML Engineering

About the role

What you'll do

Build Agentic & Intelligent AI Systems

  • Design and implement LLM-powered systems capable of multi-step reasoning, evidence grounding, and decision support in high-stakes compliance environments
  • Develop agentic workflows that combine retrieval, tool use, structured reasoning, and human oversight
  • Create interactive AI experiences that allow users to engage naturally with complex compliance and risk data

Automated Reasoning Over Regulations & Evidence

  • Build AI systems that reason over structured and unstructured data to support regulatory interpretation, control validation, and risk assessment
  • Ensure AI outputs are traceable, explainable, and auditable, meeting the expectations of enterprise compliance teams

Production-Grade AI Architecture

  • Architect and deploy scalable LLM + retrieval + agent systems in production environments
  • Optimize for latency, cost, reliability, and evaluation in real-world enterprise workloads
  • Partner with platform, security, product teams, and other application development teams to operationalize AI safely and effectively

Responsible & Trustworthy AI

  • Embed human-in-the-loop workflows, confidence thresholds, and safety guardrails into AI systems
  • Ensure privacy-preserving data handling, robust failure modes, and transparent behavior aligned with Drata's values

What you'll bring

Experience

  • 5+ years of hands-on software engineering experience
  • 2+ years specifically in ML/AI engineering

Technical Skills

  • Proficiency in Python; TypeScript experience is a plus, especially for production AI system integration
  • Familiarity with vector databases (Pinecone, Chroma, FAISS, etc.) and RAG system design
  • Proven experience building and shipping LLM-based applications in production, including embeddings, RAG, agent frameworks, prompt engineering
  • Track record of taking AI systems from concept to production, designing scalable, maintainable solutions

Soft Skills

  • Ability to decompose complex tasks into agentic workflows and reason over high-stakes, structured, and unstructured data
  • Experience working cross-functionally with product, compliance, security, and engineering teams

Bonus Qualifications

  • Experience in compliance, security, risk, or audit domains
  • Familiarity with Snowflake-based analytics, knowledge graphs, or enterprise data platforms
  • Experience partnering with non-technical stakeholders such as compliance or GRC teams

Impact

  • Establish foundational agentic AI capabilities that power multiple present and future product experiences
  • Enable customers to derive accurate, explainable insights from complex compliance and security data
  • Set the technical and ethical standard for applying modern AI in regulated, high-stakes environments

How we support you

  • Competitive base salary, benefits, and stock (typically RSUs)
  • Up to 100% employer-paid medical, dental, and vision premiums
  • 401(k) plan, company-paid life and disability insurance
  • Paid parental leave after six months
  • Generous annual professional and personal development stipends
  • Flexible vacation policy and paid holidays
  • Equity participation with RSUs

Skills

PythonTypeScriptLLMsRAGVector DatabasesPineconeChromaFaissEmbeddingsPrompt EngineeringAgent FrameworksMachine LearningAi Systems

Similar roles

ML Engineering jobs
Drata

Senior Applied Research Engineer

DrataSan Francisco, CA

Senior Applied Research Engineer driving AI system quality through experimentation and evaluation of RAG, retrieval, and reasoning systems. Requires 5+ years applied ML/NLP experience with strong Python and evaluation methodology skills.

167k – 226k/yr
Hybrid5+ YOEML Engineering
Mercury

Senior Machine Learning Operations Engineer

MercurySan Francisco, CA +2

Build and operate Mercury's real-time ML inference platform for fraud risk decisioning. Own model deployment, observability, and lifecycle tooling with strong backend Python fundamentals.

167k – 208k/yr
Hybrid5+ YOEML Engineering
Databricks

Senior Software Engineer, Model Serving

DatabricksSan Francisco, CA

Designs and builds scalable infrastructure for high-throughput, low-latency AI/ML model serving on CPU/GPU. Requires 5+ years in distributed systems, inference expertise, and strong system design skills.

166k – 225k/yr
On-site5+ YOEML Engineering
Databricks

Senior Machine Learning Engineer - GenAI Platform

DatabricksSan Francisco, CA

Build customer-facing generative AI platform covering ML lifecycle from data generation to agent-building. Requires 4+ years experience in distributed systems and ML platforms, with strong product ownership.

166k – 225k/yr
On-site4+ YOEML Engineering
Ambient.ai

Senior Software Engineer, AI Infrastructure

Ambient.aiRedwood City, CA

Build and optimize scalable AI infrastructure for real-time inference, evaluation, and continuous improvement of LLMs, LVMs, computer vision, and multimodal models on large-scale video data. Requires 4+ years production ML systems experience, strong Python skills, and expertise in inference optimization and model serving.

168k – 205k/yr
Hybrid4+ YOEML Engineering