# Staff Software Engineer, Public Sector

**Company:** [Scale AI](https://hotfix.jobs/companies/scale-ai)
**Location:** San Francisco, CA, St. Louis, MO, New York, NY, Washington, DC
**Role:** ML Engineering
**Salary:** $189k – $362k/yr
**Skills:** JavaScript, React, Node.js, Python, AWS, Azure, GCP, Docker, Kubernetes, SQL, ETL, LLMs, RAG, Data Pipelines
**Posted:** 2026-03-31

> Leads development of agentic AI systems for public sector, including guardrails, data processing, and fleet orchestration for federal datasets. Mentors engineers, defines technical strategy, and communicates with stakeholders to ensure reliable, secure solutions.

## Job Description

## Responsibilities
- Orchestrate feature implementation across the Federal engineering team to ensure architectural consistency.
- Define technical strategy for agentic guardrails, explainability, and fleet orchestration.
- Ensure system reliability and performance across multiple security classifications and network types.
- Mentor engineers in defining requirements with stakeholders and gathering acceptance.
- Communicate high-level technical trade-offs and implementation strategies to senior government stakeholders and Scale C-Suite members.
- Influence the long-term product strategy and technical roadmap for the Federal business unit.
- Consult on the architecture of AI-powered solutions for large-scale federal contracts.
- Build systems to ingest and process federal datasets for real-time decision-making.
- Create multi-layered guardrails around agents.
- Optimize data retrieval for agents.
- Orchestrate fleets of asynchronous agents.
- Automatically alert users to deviations in data.
- Illustrate how an agent reached a decision.

## Requirements
- **Full Stack Development**: Proficiency in front-end, back-end development and infrastructure, including modern web development frameworks, programming languages, and databases.
- **Cloud-Native Technologies**: Familiarity with cloud platforms (e.g., AWS, Azure, GCP), containerization (**Docker**), and orchestration (**Kubernetes**).
- **Data Engineering**: Knowledge of ETL processes, building data pipelines, data modeling, data warehousing, and data governance.
- **AI Application Integration**: Familiarity with integrating Large Language Models (**LLMs**), agentic workflows, prompt engineering, retrieval-augmented generation (**RAG**), and agent orchestration.
- Strong analytical and problem-solving skills.
- Excellent collaboration and communication skills.
- Adaptability and learning agility.

## Similar roles

- [Staff Machine Learning Engineer, Computer Vision](https://hotfix.jobs/jobs/2969c5c0-8479-43bb-b9b6-f8df93b528d7) - Pinterest - San Francisco, CA - $189k – $390k/yr
- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/3c08f024-1b6c-4c43-86de-db177792a225) - Pinterest - San Francisco, CA - $189k – $390k/yr
- [Staff Software Engineer, AI Runtime](https://hotfix.jobs/jobs/2ea7944c-45ee-4f48-8c85-a9ae03a53b15) - Databricks - Mountain View, CA - $190k – $265k/yr
- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/d1943f91-7f1d-4c37-840b-24ef6a11d96b) - Databricks - San Francisco, CA - $190k – $285k/yr
- [Senior Member of Technical Staff, Harness Engineering](https://hotfix.jobs/jobs/57cb1015-ee62-43fd-9ce7-417631c12037) - Harper - San Francisco, CA - $187k – $264k/yr

**Apply:** https://hotfix.jobs/jobs/35678132-b73b-4f45-aba8-96693a5ed591
**Canonical:** https://hotfix.jobs/jobs/35678132-b73b-4f45-aba8-96693a5ed591