Skip to content
HarveyHarveySan Francisco, CA

Staff Software Engineer, Backend

Leads backend engineering projects for AI-powered legal SaaS products, building scalable systems for peta-byte document retrieval, multi-region GPU management, advanced planning agents, and government-level security. Requires 10+ years backend experience on product teams.

231k – 340k/yr
Hybrid10+ YOEBackend Engineering

About the role

What You'll Do

  • Retrieval over peta-byte scale documents
  • Organizational-level interfaces to collaborate with AI
  • Managing dedicated GPU capacity across 5+ regions
  • 1000-step planning agents that help take companies public
  • Government-level security for the world's most sensitive matters
  • Evaluating LLMs across a 10k+ leaf taxonomy of tasks
  • Internet-scale data collection from over 50+ jurisdictions

What You Have

  • 10+ years (post-BS/MS) of backend-focused software engineering experience on product-centric teams
  • Track record of building fast-growing SaaS products by leveraging PWA technologies
  • Track record of shipping highly intuitive products, strong attention to detail
  • Experience building backend platforms that can support multiple product lines
  • Strong programming skills and general Computer Science knowledge
  • Grit - experience working at early-stage startups is a plus

Compensation

$231,000 - $340,000 USD

Skills

Backend DevelopmentSaaS PlatformsPwaGpu ManagementLlm EvaluationScalable SystemsComputer ScienceAi InterfacesSecurityData Collection

Similar roles

Backend Engineering jobs
Harvey

Staff Software Engineer, AI Platform

HarveySan Francisco, CA +1

Builds AI platform infrastructure including model integration, routing, context management, and evaluation tooling to power agentic products. Requires 5+ years backend experience with 1+ year AI/ML focus and track record of shared platforms.

231k – 340k/yr
Hybrid5+ YOEBackend Engineering
Tines

Staff Software Engineer

TinesUnited States

Lead technical direction and scale backend job processing systems and code execution engines for an intelligent workflow platform. Requires 10+ years experience with Linux systems, container runtimes, and low-level primitives in Rust or Go.

230k – 250k/yr
Remote10+ YOEBackend Engineering
Machinify

Software Architect

MachinifyUnited States

Designs and implements intelligent document processing and agentic evaluation frameworks for healthcare AI platform, owning architecture from APIs to production code. Requires 10+ years experience with Python/Scala, LLM integration, and scalable systems.

230k – 280k/yr
Remote10+ YOEBackend Engineering
Anterior

Senior Member of Technical Staff

AnteriorNew York, NY +1

Senior engineer owning end-to-end problems in backend services, APIs, data pipelines, and AWS infrastructure for an AI-powered healthcare platform. Drives system design, reliability, and customer integrations with depth in scalable systems.

230k – 300k/yr
On-siteBackend Engineering
Maybern

Staff Software Engineer

MaybernNew York, NY

Staff Software Engineer leading complex technical initiatives, system architecture, and mentoring at an early-stage NYC fintech startup building fund management software.

230k – 270k/yr
On-site7+ YOEBackend Engineering