# AI Operations Specialist
**Company:** [Bretton AI](https://hotfix.jobs/companies/bretton-ai)
**Location:** San Francisco, CA
**Salary:** $90K-$105K
**Experience:** 1+ years
**Skills:** SQL, Ai Monitoring, Performance Drift Detection, Human Scoring Pipelines, Dataset Preparation, Dashboards, Scripting
**Posted:** 2026-03-20
> Monitors and reviews AI agent performance for financial crime detection in banks and fintechs, tests features, analyzes data patterns, and collaborates with engineering and customers to improve the platform. Requires 1-3 years experience, strong analytical skills, and interest in AI/ML systems.
## Job Description
## What You'll Do
- Conduct quality reviews of AI agents to ensure they meet the highest standards for compliance teams at banks and fintechs
- Test new features and custom logic before they go live for customers
- Analyze case data to identify patterns, issues, and opportunities for improvement
- Work directly with engineering to understand and measure the impact of system changes
- Learn state-of-the-art AI monitoring techniques including performance drift detection, human scoring pipelines, and dataset preparation
- Support our largest customers by providing operational insights and recommendations
- Partner with product and engineering to translate operational findings into platform improvements

## What We're Looking For
- 1–3 years of professional experience or equivalent internship experience
- Strong analytical and critical thinking skills with exceptional attention to detail
- Ability to review complex information and identify patterns or issues
- Comfortable learning new technical systems independently
- Strong written and verbal communication skills
- Excited to work in a fast-paced startup environment

**Bonus Points**
- Exposure to financial services, fintech, or regulated industries
- Experience at a fast-paced startup
- Familiarity with coding/scripting — SQL, dashboards, quick scripts
- Customer-facing experience in any capacity
- Genuine interest in AI/ML systems and how they're deployed in the real world

## Compensation & Benefits
- $90k – $105k base salary + equity
- Comprehensive healthcare, 401k matching, commuter benefits
- 15 days PTO + holidays, unlimited sick days
- Flexible leave options
**Apply:** https://hotfix.jobs/jobs/ai-operations-specialist-at-bretton-ai-31d88b64-01bf-4682-9049-665a5c4de5b0
**Canonical:** https://hotfix.jobs/jobs/ai-operations-specialist-at-bretton-ai-31d88b64-01bf-4682-9049-665a5c4de5b0