Skip to content
ShepherdShepherdSan Francisco, CA

Software Engineer, Applied AI

Builds and deploys production AI systems including LLM-powered features, agents, and RAG for underwriting, pricing, and risk evaluation in insurance. Requires 5+ years backend experience, hands-on AI product shipping, and familiarity with LLMs and vector DBs.

170k – 220k/yr
On-site5+ YOEML Engineering

About the role

What You’ll Do

  • Partner with product, engineering, underwriting, and data teams to identify high-leverage AI opportunities
  • Design, build, and deploy LLM-powered features across underwriting, pricing, and internal tooling
  • Develop AI agents and retrieval-augmented systems that extract structured insights from unstructured insurance data
  • Build production-grade AI infrastructure for model serving, inference, evaluation, and monitoring
  • Create internal AI tools that enable underwriters and operators to move faster with higher quality decisions
  • Establish best practices for prompt engineering, evaluation frameworks, and model reliability
  • Own AI features end-to-end from ideation to production

What We’re Looking For

  • Strong backend engineering experience building scalable APIs and distributed systems
  • Hands-on experience shipping AI-powered products into production
  • Familiarity with LLMs, RAG architectures, embeddings, and vector databases
  • Experience integrating AI systems into user-facing or workflow-driven applications
  • Comfort with cloud infrastructure and deploying AI workloads at scale
  • A product mindset and the ability to translate ambiguous business problems into concrete AI systems
  • You have at least 5+ years of working experience (preferably as a full-stack engineer) with a track record of delivering high-impact products

Bonus Points

  • Experience building AI agents or multi-step reasoning systems
  • Background in applied machine learning beyond generative AI
  • Experience with pricing systems, financial infrastructure, or risk modeling
  • Interest in transforming legacy industries with modern AI systems

Tech Stack

Frontend
React & Next.js
Typescript
GraphQL w/ Apollo

Backend
Node.js
Postgres & Redis
Typescript
GraphQL APIs

Benefits

  • Premium Healthcare (100% contribution to top-tier health, dental, and vision)
  • Fertility benefits and family building support
  • Unlimited PTO
  • Daily lunches, dinners, and snacks
  • Offices: SF, NYC, Dallas-Fort Worth, Chicago, LA
  • Professional Development (premium coaching, leadership development)
  • Competitive 401(k) Plan
  • Dog-friendly office (SF)

Skills

LLMsRAGAI AgentsVector DatabasesPrompt EngineeringNode.jsTypeScriptGraphQLPostgresRedisReactNext.jsCloud Infrastructure

Similar roles

ML Engineering jobs
Airbnb

Machine Learning Engineer

AirbnbSan Francisco, CA +1

Build and deploy cutting-edge Agentic AI and LLM systems to transform Airbnb's customer service experience. Requires PhD or equivalent experience and production ML/AI deployment expertise.

170k – 180k/yr
On-site3+ YOEML Engineering
Notable

AI Platform Engineer

NotableSan Mateo, CA

Design, build, and maintain LLM integrations powering AI features. Own end-to-end delivery from requirements through production monitoring with focus on scalability and reliability.

170k – 205k/yr
Hybrid5+ YOEML Engineering
Skydio

Autonomy Engineer - ML & DL Infrastructure

SkydioSan Mateo, CA

Builds and scales ML/DL infrastructure including data pipelines, annotation workflows, training, deployment, and monitoring for autonomous drone systems. Requires hands-on experience in data engineering, cloud ML platforms, containerization, and MLOps.

170k – 278k/yr
HybridML Engineering
Forus

Research Engineer

ForusNew York, NY

Research Engineer building production LLM and ML systems for healthcare workflows. Requires strong ML/NLP research background with publications, production deployment experience, and proficiency in PyTorch/TensorFlow/JAX.

170k – 300k/yr
On-siteML Engineering
Fieldguide

AI Engineer, Quality (Evals)

FieldguideSan Francisco, CA

Owns evaluation infrastructure for AI agents in audit workflows, building unified platforms, automated pipelines, observability, and feedback loops to ensure enterprise-scale reliability. Requires experience with LLMs, TypeScript/Python, and production AI systems.

170k – 220k/yr
Remote3+ YOEML Engineering