Skip to content
HarperHarperSan Francisco, CA

Senior Member of Technical Staff

Senior engineer owning end-to-end AI infrastructure including LLM orchestration, agent architectures, evaluation systems, and scalable platforms for insurance quoting. Requires 3-6 years experience with production AI systems and strong architectural skills.

160k – 230k/yr
On-siteML Engineering

About the role

Responsibilities

  • Own core AI infrastructure — LLM orchestration, prompt management, retrieval systems, structured output parsing
  • Design agent architecture — Define abstractions that let us ship new agents in days
  • Build evaluation that works — Systems that measure whether agents are getting better at closing deals
  • Architect decision trace capture — Make every AI judgment traceable
  • Own platform scale — Thousands of concurrent conversations, sub-second response times

Requirements

  • 3-6 years software engineering experience
  • Production experience with LLM applications and AI systems
  • Strong architectural skills with hands-on implementation
  • Track record of owning systems end-to-end
  • Based in San Francisco or willing to relocate

Nice to Have

  • Voice AI or real-time systems experience
  • Experience building agent frameworks or evaluation systems
  • Prior startup experience

Compensation

  • Salary: $160,000–$230,000 + performance bonuses & equity
  • Health, dental, and vision insurance
  • Commuter benefits
  • Team meals and snacks

Skills

Llm OrchestrationPrompt ManagementRetrieval SystemsRAGAgent FrameworksStructured Output ParsingEvaluation SystemsVoice AiReal-Time SystemsPython

Similar roles

ML Engineering jobs
Mariana Minerals

Staff Machine Learning Engineer

Mariana MineralsAnn Arbor, MI

Staff ML Engineer setting technical direction for autonomous mineral refining using reinforcement learning and simulation. Owns modeling, validation, and deployment of control systems on live industrial equipment.

160k – 200k/yr
On-site8+ YOEML Engineering
Roe AI

Founding Staff Engineer, AI Agent

Roe AISan Mateo, CA

Builds sophisticated AI agent products for investigating financial crimes, leads technical designs and teams. Requires 4-10 years experience in software development, Python, cloud infrastructure, and hybrid SF Bay Area work.

160k – 200k/yr
Hybrid4+ YOEML Engineering
Square

Staff Machine Learning Engineer, Modeling, Support

SquareSeattle, WA

Lead end-to-end delivery of ML initiatives for customer support, focusing on conversational AI and generative AI. Partner with cross-functional teams to define ML roadmaps and drive R&D efforts for next-generation chatbot architectures.

161k – 284k/yr
On-site10+ YOEML Engineering
Gusto

Retirement AI Staff Engineer

GustoDenver, CO +2

Staff Engineer building and shipping LLM-powered retirement features end-to-end. Owns architecture decisions, integrates models, and collaborates closely with product and design.

164k – 247k/yr
Hybrid7+ YOEML Engineering
Harvey

Mid/Senior/Staff Software Engineer, Agents

HarveySan Francisco, CA +1

Build AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evals. Requires 3+ years experience, Python proficiency, and LLM/agent framework expertise for mid/senior/staff levels.

165k – 312k/yr
On-siteML Engineering