Skip to content
ShepherdShepherd

Software Engineer, Applied AI

Builds and deploys production AI systems including LLM-powered features, agents, and RAG for underwriting, pricing, and risk evaluation in insurance. Requires 5+ years backend experience, hands-on AI product shipping, and familiarity with LLMs and vector DBs.

About the job

What You’ll Do

  • Partner with product, engineering, underwriting, and data teams to identify high-leverage AI opportunities
  • Design, build, and deploy LLM-powered features across underwriting, pricing, and internal tooling
  • Develop AI agents and retrieval-augmented systems that extract structured insights from unstructured insurance data
  • Build production-grade AI infrastructure for model serving, inference, evaluation, and monitoring
  • Create internal AI tools that enable underwriters and operators to move faster with higher quality decisions
  • Establish best practices for prompt engineering, evaluation frameworks, and model reliability
  • Own AI features end-to-end from ideation to production

What We’re Looking For

  • Strong backend engineering experience building scalable APIs and distributed systems
  • Hands-on experience shipping AI-powered products into production
  • Familiarity with LLMs, RAG architectures, embeddings, and vector databases
  • Experience integrating AI systems into user-facing or workflow-driven applications
  • Comfort with cloud infrastructure and deploying AI workloads at scale
  • A product mindset and the ability to translate ambiguous business problems into concrete AI systems
  • You have at least 5+ years of working experience (preferably as a full-stack engineer) with a track record of delivering high-impact products

Bonus Points

  • Experience building AI agents or multi-step reasoning systems
  • Background in applied machine learning beyond generative AI
  • Experience with pricing systems, financial infrastructure, or risk modeling
  • Interest in transforming legacy industries with modern AI systems

Tech Stack

Frontend
React & Next.js
Typescript
GraphQL w/ Apollo

Backend
Node.js
Postgres & Redis
Typescript
GraphQL APIs

Benefits

  • Premium Healthcare (100% contribution to top-tier health, dental, and vision)
  • Fertility benefits and family building support
  • Unlimited PTO
  • Daily lunches, dinners, and snacks
  • Offices: SF, NYC, Dallas-Fort Worth, Chicago, LA
  • Professional Development (premium coaching, leadership development)
  • Competitive 401(k) Plan
  • Dog-friendly office (SF)

Skills

LLMs, RAG, AI Agents, Vector Databases, Prompt Engineering, Node.js, TypeScript, GraphQL, Postgres, Redis, React, Next.js, Cloud Infrastructure

Clay

Clay

New York, NY

Software Engineer, Applied AI
$170k+/yrHybridML Engineering

Build and ship production AI agents and the platform infrastructure that makes them reliable, steerable, and measurable. The role requires strong backend fundamentals, production LLM or agent experience, and expertise in evaluations, retrieval, orchestration, or tool-use design.

Clay

Clay

San Francisco, CA

Machine Learning Engineer
$170k+/yrHybrid5+ YOEML Engineering

Build and ship production machine-learning systems that learn from customer data and behavior, including recommendations, LLM-powered features, evaluation systems, and ML infrastructure. The role requires 5+ years of ML engineering or ML-heavy software engineering experience and strong production systems expertise.

Mirage

Mirage

New York, NY

Software Engineer, Agents
$175k+/yrOn-site5+ YOEML Engineering

Build and deploy agentic systems that power AI-driven creative video workflows. The role requires 5+ years of experience, production ML or agentic pipeline development, context engineering, and expertise in evaluation and agent infrastructure.

Mirage

Mirage

New York, NY

Research Engineer, Agentic Systems
$175k+/yrOn-siteML Engineering

Build and advance agentic machine-learning systems for multimodal creative tasks, with a focus on video understanding, reasoning, control, and tool use. The role requires strong production ML or agent-pipeline experience and deep knowledge of modern LLM techniques.

Taste Labs

Taste Labs

San Francisco, CA

AI Engineer, RL
$175k+/yrOn-siteML Engineering

Build evaluation methods, RL environments, agent tooling, and scalable infrastructure that make subjective qualities such as design and taste measurable for frontier AI models. The role requires experience with evaluations, RL environments, ML or post-training, plus strong backend engineering skills.