# Senior Staff Forward Deployed AI Engineer, Enterprise

**Company:** [Scale AI](https://hotfix.jobs/companies/scale-ai)
**Location:** San Francisco, CA, New York, NY
**Role:** Solutions Architecture
**Salary:** $288k – $360k/yr
**Experience:** 12+ years
**Skills:** Python, LangChain, Llamaindex, Hugging Face, OpenAI API, AWS, GCP, Azure, Docker, Kubernetes, Terraform, RAG, LLMs, Vector Databases, ETL
**Posted:** 2026-05-15

> Hands-on technical role deploying and integrating production AI agents and systems for strategic enterprise customers, bridging Scale AI's platform with customer infrastructure and workflows. Requires 12+ years of software engineering experience and deep expertise in Python, modern ML frameworks, and cloud platforms.

## Job Description

## Key Responsibilities

### Customer Integration & Deployment
- Partner directly with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements
- Design and implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
- Build robust data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows
- Deploy and configure AI models and agents within customer security and compliance boundaries

### AI Agent Development
- Develop production-grade AI agents tailored to customer use cases across domains like customer support, data analysis, content generation, and workflow automation
- Architect multi-agent systems that orchestrate between different models, tools, and data sources
- Implement evaluation frameworks to measure agent performance and iterate toward business objectives
- Design human-in-the-loop workflows and feedback mechanisms for continuous agent improvement

### Prompt Engineering & Optimization
- Create sophisticated prompt engineering strategies optimized for customer-specific domains and data
- Build and maintain prompt libraries, templates, and best practices for customer use cases
- Conduct systematic prompt experimentation and A/B testing to improve model outputs
- Implement RAG (Retrieval Augmented Generation) systems and fine-tuning pipelines where appropriate

### Technical Leadership & Collaboration
- Serve as the primary technical point of contact for strategic enterprise accounts
- Collaborate with customer data scientists, ML engineers, and software developers to ensure smooth integration
- Provide technical training and knowledge transfer to customer teams
- Work closely with Scale's product and engineering teams to translate customer needs into product improvements
- Document technical architectures, integration patterns, and best practices

### Problem Solving & Innovation
- Debug complex technical issues across the entire stack, from data pipelines to model outputs
- Rapidly prototype solutions to unblock customers and prove out new use cases
- Stay current on the latest AI/ML research and tools, bringing innovative approaches to customer problems
- Identify opportunities for productization based on common customer patterns

## Required Qualifications
- 12+ years of software engineering experience with strong fundamentals in data structures, algorithms, and system design
- Production Python expertise with experience in modern ML/AI frameworks (e.g., LangChain, LlamaIndex, HuggingFace, OpenAI API)
- Experience with cloud platforms (AWS, GCP, or Azure) and modern data infrastructure
- Strong problem-solving skills with the ability to navigate ambiguous requirements and rapidly iterate toward solutions
- Excellent communication skills with the ability to explain complex technical concepts to both technical and non-technical audiences

## Preferred Qualifications

### Agent Development Wiz
- Deep understanding of LLMs including prompting techniques, embeddings, and RAG architectures
- Experience building and deploying AI agents or autonomous systems in production
- Knowledge of vector databases and semantic search systems
- Contributions to open-source AI/ML projects

### Infrastructure Guru
- Experience with containerization (Docker, Kubernetes) and CI/CD pipelines
- Experience using Terraform, Bicep, or other Infrastructure as Code (IaC) tools
- Previous work in a devops, platform, or infra role
- Familiarity with enterprise security, compliance, and governance requirements (SOC 2, GDPR, HIPAA)

### Customer Product Whisperer
- Proven ability to work with customers in a technical consulting, solutions engineering, or product engineering role
- Domain expertise in verticals like finance, healthcare, government, or manufacturing
- Experience with technical enablement or teaching programs

## Compensation & Benefits
- Base salary range: $288,000–$360,000 USD
- Equity compensation
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend (role may be eligible)

## Similar roles

- [Field CTO](https://hotfix.jobs/jobs/324a8e51-b1f9-4122-b5b4-6f5aeabd4937) - Databricks - Maryland - $264k – $363k/yr
- [Staff Forward Deployed AI Engineer, Enterprise](https://hotfix.jobs/jobs/f07c5906-7dbd-4943-8247-f8e3a144bf2e) - Scale AI - San Francisco, CA - $252k – $315k/yr
- [Staff/Senior Staff Business Enablement Architect](https://hotfix.jobs/jobs/41a81cb2-9d95-46ec-92ff-dbb29e0e0642) - Zoox - Foster City, CA - $252k – $303k/yr
- [Staff Solutions Architect, Growth](https://hotfix.jobs/jobs/4595e595-3d0d-499f-bcc3-485b7846a635) - Temporal - Remote - $250k – $300k/yr
- [Staff Solutions Architect](https://hotfix.jobs/jobs/54605277-6829-4ea3-8f0f-5ed14457f984) - Temporal - Remote - $250k – $300k/yr

**Apply:** https://hotfix.jobs/jobs/bb16d4ce-2224-4232-9d19-7f3ab2ae219e
**Canonical:** https://hotfix.jobs/jobs/bb16d4ce-2224-4232-9d19-7f3ab2ae219e