Skip to content
Scale AIScale AISan Francisco, CA

Staff Software Engineer, Public Sector

Leads development of agentic AI systems for public sector, including guardrails, data processing, and fleet orchestration for federal datasets. Mentors engineers, defines technical strategy, and communicates with stakeholders to ensure reliable, secure solutions.

189k – 362k
On-siteML Engineering

About the role

Responsibilities

  • Orchestrate feature implementation across the Federal engineering team to ensure architectural consistency.
  • Define technical strategy for agentic guardrails, explainability, and fleet orchestration.
  • Ensure system reliability and performance across multiple security classifications and network types.
  • Mentor engineers in defining requirements with stakeholders and gathering acceptance.
  • Communicate high-level technical trade-offs and implementation strategies to senior government stakeholders and Scale C-Suite members.
  • Influence the long-term product strategy and technical roadmap for the Federal business unit.
  • Consult on the architecture of AI-powered solutions for large-scale federal contracts.
  • Build systems to ingest and process federal datasets for real-time decision-making.
  • Create multi-layered guardrails around agents.
  • Optimize data retrieval for agents.
  • Orchestrate fleets of asynchronous agents.
  • Automatically alert users to deviations in data.
  • Illustrate how an agent reached a decision.

Requirements

  • Full Stack Development: Proficiency in front-end, back-end development and infrastructure, including modern web development frameworks, programming languages, and databases.
  • Cloud-Native Technologies: Familiarity with cloud platforms (e.g., AWS, Azure, GCP), containerization (Docker), and orchestration (Kubernetes).
  • Data Engineering: Knowledge of ETL processes, building data pipelines, data modeling, data warehousing, and data governance.
  • AI Application Integration: Familiarity with integrating Large Language Models (LLMs), agentic workflows, prompt engineering, retrieval-augmented generation (RAG), and agent orchestration.
  • Strong analytical and problem-solving skills.
  • Excellent collaboration and communication skills.
  • Adaptability and learning agility.

Skills

JavaScriptReactNode.jsPythonAWSAzureGCPDockerKubernetesSQLETLLLMsRAGData Pipelines

Similar roles

ML Engineering jobs
Pinterest

Staff Machine Learning Engineer, Computer Vision

PinterestSan Francisco, CA

Staff Machine Learning Engineer developing state-of-the-art visual encoders and multimodal models at Pinterest Labs. Prototype visual reasoning tools, train billion-scale models on rich visual-text data, ship to production for recommender systems and VLMs, publish research, and mentor juniors. Requires strong CV/ML background, publications, and PhD or equivalent.

189k – 390k
Hybrid7+ YOEML Engineering
Pinterest

Staff Machine Learning Engineer

PinterestSan Francisco, CA +1

As a Staff Machine Learning Engineer, you will lead the ML strategy and execution for the Advertiser and Seller Experience team, building recommendation systems and context foundations. This role requires deep expertise in recommendation systems and modern agentic AI to shape advertiser and seller workflows.

189k – 390k
Hybrid7+ YOEML Engineering
Databricks

Staff Software Engineer, AI Runtime

DatabricksMountain View, CA +1

Staff Software Engineer building and scaling Databricks' managed large-scale GPU training platform (AIR). Focus on distributed training performance, scheduling, fault tolerance, and developer experience for thousands of accelerators.

190k – 265k
On-site10+ YOEML Engineering
Databricks

Staff Machine Learning Engineer

DatabricksSan Francisco, CA +1

Develops and deploys state-of-the-art GenAI models and systems for Databricks products like Assistant and Genie. Requires 2-8 years ML engineering experience, proficiency in Python/PyTorch/TensorFlow, and expertise in LLMs.

190k – 285k
HybridML Engineering
Harper

Senior Member of Technical Staff, Harness Engineering

HarperSan Francisco, CA

As a Senior Member of Technical Staff, Harness Engineering, you will build the core substrate for Harper's AI agents, focusing on agent loop primitives, execution environment infrastructure, and tool layer ownership. You will work with frontier coding agents and internal agents, shipping primitives that agent teams depend on.

187k – 264k
On-site3+ YOEML Engineering