Skip to content

Senior AI Engineer, Agent Harness

Senior AI Engineer to design, build, and scale agentic AI systems using LLMs for compliance automation. Own end-to-end development of production LLM + retrieval + agent workflows with focus on responsible AI.

167k – 226kSan Francisco, CAML EngineeringHybrid5+ YOE

About the role

What you'll do

Build Agentic & Intelligent AI Systems

  • Design and implement LLM-powered systems capable of multi-step reasoning, evidence grounding, and decision support in high-stakes compliance environments
  • Develop agentic workflows that combine retrieval, tool use, structured reasoning, and human oversight
  • Create interactive AI experiences that allow users to engage naturally with complex compliance and risk data

Automated Reasoning Over Regulations & Evidence

  • Build AI systems that reason over structured and unstructured data to support regulatory interpretation, control validation, and risk assessment
  • Ensure AI outputs are traceable, explainable, and auditable, meeting the expectations of enterprise compliance teams

Production-Grade AI Architecture

  • Architect and deploy scalable LLM + retrieval + agent systems in production environments
  • Optimize for latency, cost, reliability, and evaluation in real-world enterprise workloads
  • Partner with platform, security, product teams, and other application development teams to operationalize AI safely and effectively

Responsible & Trustworthy AI

  • Embed human-in-the-loop workflows, confidence thresholds, and safety guardrails into AI systems
  • Ensure privacy-preserving data handling, robust failure modes, and transparent behavior aligned with Drata's values

What you'll bring

Experience

  • 5+ years of hands-on software engineering experience
  • 2+ years specifically in ML/AI engineering

Technical Skills

  • Proficiency in Python; TypeScript experience is a plus, especially for production AI system integration
  • Familiarity with vector databases (Pinecone, Chroma, FAISS, etc.) and RAG system design
  • Proven experience building and shipping LLM-based applications in production, including embeddings, RAG, agent frameworks, prompt engineering
  • Track record of taking AI systems from concept to production, designing scalable, maintainable solutions

Soft Skills

  • Ability to decompose complex tasks into agentic workflows and reason over high-stakes, structured, and unstructured data
  • Experience working cross-functionally with product, compliance, security, and engineering teams

Bonus Qualifications

  • Experience in compliance, security, risk, or audit domains
  • Familiarity with Snowflake-based analytics, knowledge graphs, or enterprise data platforms
  • Experience partnering with non-technical stakeholders such as compliance or GRC teams

Impact

  • Establish foundational agentic AI capabilities that power multiple present and future product experiences
  • Enable customers to derive accurate, explainable insights from complex compliance and security data
  • Set the technical and ethical standard for applying modern AI in regulated, high-stakes environments

How we support you

  • Competitive base salary, benefits, and stock (typically RSUs)
  • Up to 100% employer-paid medical, dental, and vision premiums
  • 401(k) plan, company-paid life and disability insurance
  • Paid parental leave after six months
  • Generous annual professional and personal development stipends
  • Flexible vacation policy and paid holidays
  • Equity participation with RSUs

Skills

PythonTypeScriptLLMsRAGVector DatabasesPineconeChromaFaissEmbeddingsPrompt EngineeringAgent FrameworksMachine LearningAi Systems

Similar roles

ML Engineering jobs

Senior Applied Research Engineer

Senior Applied Research Engineer driving AI system quality through experimentation and evaluation of RAG, retrieval, and reasoning systems. Requires 5+ years applied ML/NLP experience with strong Python and evaluation methodology skills.

167k – 226kSan Francisco, CAML EngineeringHybrid5+ YOERAGNLP

Senior Machine Learning Operations Engineer

Build and operate Mercury's real-time ML inference platform for fraud risk decisioning. Own model deployment, observability, and lifecycle tooling with strong backend Python fundamentals.

167k – 208kSan Francisco, CA +2ML EngineeringHybrid5+ YOESQLShap

Senior Software Engineer, Model Serving

Designs and builds scalable infrastructure for high-throughput, low-latency AI/ML model serving on CPU/GPU. Requires 5+ years in distributed systems, inference expertise, and strong system design skills.

166k – 225kSan Francisco, CAML EngineeringOn-site5+ YOEGPURouting

Senior Machine Learning Engineer - GenAI Platform

Build customer-facing generative AI platform covering ML lifecycle from data generation to agent-building. Requires 4+ years experience in distributed systems and ML platforms, with strong product ownership.

166k – 225kSan Francisco, CAML EngineeringOn-site4+ YOEGoC++

Senior Software Engineer, Backend - AI Platform

As a Senior Software Engineer on the AI Platform team, you will own end-to-end technical design and implementation for high-impact AI platform initiatives. You will build scalable agent infrastructure, design observable and self-correcting systems, and mentor junior engineers.

168k – 280kSan Francisco, CA +2ML EngineeringHybrid5+ YOEAI AgentsSystem Design