Senior AI Engineer to design, build, and scale agentic AI systems using LLMs for compliance automation. Own end-to-end development of production LLM + retrieval + agent workflows with focus on responsible AI.
167k – 226k/yr
Hybrid5+ YOEML Engineering
About the role
What you'll do
Build Agentic & Intelligent AI Systems
Design and implement LLM-powered systems capable of multi-step reasoning, evidence grounding, and decision support in high-stakes compliance environments
Develop agentic workflows that combine retrieval, tool use, structured reasoning, and human oversight
Create interactive AI experiences that allow users to engage naturally with complex compliance and risk data
Automated Reasoning Over Regulations & Evidence
Build AI systems that reason over structured and unstructured data to support regulatory interpretation, control validation, and risk assessment
Ensure AI outputs are traceable, explainable, and auditable, meeting the expectations of enterprise compliance teams
Production-Grade AI Architecture
Architect and deploy scalable LLM + retrieval + agent systems in production environments
Optimize for latency, cost, reliability, and evaluation in real-world enterprise workloads
Partner with platform, security, product teams, and other application development teams to operationalize AI safely and effectively
Responsible & Trustworthy AI
Embed human-in-the-loop workflows, confidence thresholds, and safety guardrails into AI systems
Ensure privacy-preserving data handling, robust failure modes, and transparent behavior aligned with Drata's values
What you'll bring
Experience
5+ years of hands-on software engineering experience
2+ years specifically in ML/AI engineering
Technical Skills
Proficiency in Python; TypeScript experience is a plus, especially for production AI system integration
Familiarity with vector databases (Pinecone, Chroma, FAISS, etc.) and RAG system design
Proven experience building and shipping LLM-based applications in production, including embeddings, RAG, agent frameworks, prompt engineering
Track record of taking AI systems from concept to production, designing scalable, maintainable solutions
Soft Skills
Ability to decompose complex tasks into agentic workflows and reason over high-stakes, structured, and unstructured data
Experience working cross-functionally with product, compliance, security, and engineering teams
Bonus Qualifications
Experience in compliance, security, risk, or audit domains
Familiarity with Snowflake-based analytics, knowledge graphs, or enterprise data platforms
Experience partnering with non-technical stakeholders such as compliance or GRC teams
Impact
Establish foundational agentic AI capabilities that power multiple present and future product experiences
Enable customers to derive accurate, explainable insights from complex compliance and security data
Set the technical and ethical standard for applying modern AI in regulated, high-stakes environments
How we support you
Competitive base salary, benefits, and stock (typically RSUs)
Up to 100% employer-paid medical, dental, and vision premiums
401(k) plan, company-paid life and disability insurance
Paid parental leave after six months
Generous annual professional and personal development stipends
Flexible vacation policy and paid holidays
Equity participation with RSUs
Skills
PythonTypeScriptLLMsRAGVector DatabasesPineconeChromaFaissEmbeddingsPrompt EngineeringAgent FrameworksMachine LearningAi Systems
Senior Applied Research Engineer driving AI system quality through experimentation and evaluation of RAG, retrieval, and reasoning systems. Requires 5+ years applied ML/NLP experience with strong Python and evaluation methodology skills.
167k – 226k/yr
Hybrid5+ YOEML Engineering
Senior Machine Learning Operations Engineer
MercurySan Francisco, CA +2
Build and operate Mercury's real-time ML inference platform for fraud risk decisioning. Own model deployment, observability, and lifecycle tooling with strong backend Python fundamentals.
167k – 208k/yr
Hybrid5+ YOEML Engineering
Senior Software Engineer, Model Serving
DatabricksSan Francisco, CA
Designs and builds scalable infrastructure for high-throughput, low-latency AI/ML model serving on CPU/GPU. Requires 5+ years in distributed systems, inference expertise, and strong system design skills.
166k – 225k/yr
On-site5+ YOEML Engineering
Senior Machine Learning Engineer - GenAI Platform
DatabricksSan Francisco, CA
Build customer-facing generative AI platform covering ML lifecycle from data generation to agent-building. Requires 4+ years experience in distributed systems and ML platforms, with strong product ownership.
166k – 225k/yr
On-site4+ YOEML Engineering
Senior Software Engineer, AI Infrastructure
Ambient.aiRedwood City, CA
Build and optimize scalable AI infrastructure for real-time inference, evaluation, and continuous improvement of LLMs, LVMs, computer vision, and multimodal models on large-scale video data. Requires 4+ years production ML systems experience, strong Python skills, and expertise in inference optimization and model serving.