# Staff Software Engineer, AI Developer Tools

**Company:** [Gusto](https://hotfix.jobs/companies/gusto)
**Location:** Denver, CO, San Francisco, CA, New York, NY, Seattle, WA
**Role:** DevOps / SRE
**Salary:** $180k – $245k/yr
**Experience:** 8+ years
**Skills:** LLMs, RAG, Prompt Engineering, Fine-Tuning, Multi-Agent Systems, AI Infrastructure, Distributed Systems, Evaluation Frameworks, CI/CD, Developer Productivity Tools
**Posted:** 2026-06-05

> Staff-level engineer architecting AI-native developer tools and infrastructure to accelerate engineering velocity across Gusto. Requires 8+ years experience building production AI systems with deep expertise in LLMs, RAG, and multi-agent workflows.

## Job Description

## Responsibilities

- Architect AI Core Infrastructure: Design, scale, and maintain the internal platform and APIs that integrate LLMs into the developer workflow, with a heavy focus on autonomous agents, custom retrieval-augmented generation (RAG), and smart context-delivery systems.
- Drive Technical Leadership & Vision: Establish engineering best practices for building with AI at Gusto, including robust evaluation frameworks (evals), guardrails for code safety, and strategies for optimizing model latency and token spend.
- Collaborate & Evangelize: Partner closely with product engineering teams to uncover systemic friction points, and collaborate with core Infrastructure and Security teams to ensure all AI tooling is scalable, compliant, and secure.
- Optimize Feedback Loops: Identify and eliminate critical bottlenecks in the local-to-production lifecycle at scale across Gusto.
- Maintain Enterprise Reliability: Treat AI infrastructure with production-grade rigor. Monitor system health, diagnose complex integration or networking issues, and mitigate model drift or downtime.

## Requirements

- 8+ Years of Systems Expertise: Seasoned engineer comfortable navigating massive, complex codebases and delivering production-grade, distributed software.
- Production AI Experience: Proven track record of moving AI beyond prototypes. Deep understanding of prompt engineering, fine-tuning, RAG architectures, and orchestrating multi-agent workflows.
- Developer-First Mindset: Passionate about Developer Experience and Productivity. Understand what makes an internal tool frictionless, fast, and empowering for other engineers.
- Strategic Execution: Think deeply about data privacy, security, cost management, and systemic reliability when deploying AI solutions.
- Exceptional Communication: Translate bleeding-edge AI capabilities into clear, actionable infrastructure strategies, mentoring junior engineers and aligning cross-functional stakeholders.
- Working as a Team: Work across team boundaries and bring other teams and groups along towards strategic vision.

## Compensation & Benefits

- Cash compensation targeted at $180,000/yr to $200,000/yr in Denver & most remote locations, $220,000/yr to $245,000/yr for San Francisco, New York & Seattle.
- Stock equity is additional.
- All full-time employees receive competitive base pay, benefits, and equity (RSUs).

## Similar roles

- [Staff Cloud Networking Engineer](https://hotfix.jobs/jobs/a3a954a8-c6c4-45c5-80de-ba1e63da417a) - Scribe - Remote - $180k – $280k/yr
- [Staff Engineer, AI Productivity](https://hotfix.jobs/jobs/8dcfdcba-4e0d-400e-a95e-d01acbf151e3) - Hightouch - Remote - $180k – $400k/yr
- [Staff Infrastructure Engineer](https://hotfix.jobs/jobs/31b641c0-5800-45dd-bdac-4948a91afb52) - Onebrief - Remote - $180k – $235k/yr
- [Staff Software Engineer, Developer Experience](https://hotfix.jobs/jobs/39480435-169b-4bc9-b410-93f580a8caeb) - Attentive - Remote - $180k – $240k/yr
- [Staff Enterprise and Cloud Engineer](https://hotfix.jobs/jobs/7cb251e8-eccf-45c1-b5b4-12896c8df1e0) - Zocdoc - Remote - $180k – $270k/yr

**Apply:** https://hotfix.jobs/jobs/4ad0f960-2ad7-4648-829d-c4aff746157f
**Canonical:** https://hotfix.jobs/jobs/4ad0f960-2ad7-4648-829d-c4aff746157f