Skip to content
Bretton AI

AI Operations Specialist

Monitors and reviews AI agent performance for financial crime detection in banks and fintechs, tests features, analyzes data patterns, and collaborates with engineering and customers to improve the platform. Requires 1-3 years experience, strong analytical skills, and interest in AI/ML systems.

90k – 105kSan Francisco, CAOtherOnsite1+ YOE
Apply

About the role

What You'll Do

  • Conduct quality reviews of AI agents to ensure they meet the highest standards for compliance teams at banks and fintechs
  • Test new features and custom logic before they go live for customers
  • Analyze case data to identify patterns, issues, and opportunities for improvement
  • Work directly with engineering to understand and measure the impact of system changes
  • Learn state-of-the-art AI monitoring techniques including performance drift detection, human scoring pipelines, and dataset preparation
  • Support our largest customers by providing operational insights and recommendations
  • Partner with product and engineering to translate operational findings into platform improvements

What We're Looking For

  • 1–3 years of professional experience or equivalent internship experience
  • Strong analytical and critical thinking skills with exceptional attention to detail
  • Ability to review complex information and identify patterns or issues
  • Comfortable learning new technical systems independently
  • Strong written and verbal communication skills
  • Excited to work in a fast-paced startup environment

Bonus Points

  • Exposure to financial services, fintech, or regulated industries
  • Experience at a fast-paced startup
  • Familiarity with coding/scripting — SQL, dashboards, quick scripts
  • Customer-facing experience in any capacity
  • Genuine interest in AI/ML systems and how they're deployed in the real world

Compensation & Benefits

  • $90k – $105k base salary + equity
  • Comprehensive healthcare, 401k matching, commuter benefits
  • 15 days PTO + holidays, unlimited sick days
  • Flexible leave options

Skills

SQLAi MonitoringPerformance Drift DetectionHuman Scoring PipelinesDataset PreparationDashboardsScripting

Similar roles

Regal.ai

AI Product Specialist

Builds and refines AI agents using prompt engineering, conversational flows, and custom functions on the Regal platform. Tunes STT/LLM/TTS settings, conducts QA testing, delivers product feedback, and supports sales demos. Requires technical degree and 1-2 years experience.

90k – 120kNew York, NYOtherHybrid1+ YOESttTts
Fluidstack

Material Manager

Manages end-to-end hardware procurement and supply chain for datacenter infrastructure, tracking POs, vendor communications, logistics, and risks. Builds dashboards and automations; requires bachelor's in supply chain/operations and spreadsheet proficiency; 0-3 years experience.

90k – 150kAustin, TX +1OtherOn-siteEntry levelERPSAP
Fluidstack

Supply Chain Generalist

Manages end-to-end hardware procurement and supply chain for datacenter infrastructure, tracking POs, vendor communications, logistics, and building automation tools/dashboards. Requires bachelor's degree, 0-3 years experience, and spreadsheet proficiency.

90k – 150kAustin, TX +2OtherOn-siteEntry levelERPSAP
Blue Rose Research

AI Politics Fellow

Serves as in-house AI policy expert, conducting research, developing messaging strategies, and advising Democratic stakeholders on AI regulation, safety, and societal impacts. Requires 2-5 years in tech policy or campaigns, strong communication skills, and survey research familiarity.

90k – 130kNew York, NY +1OtherRemote2+ YOEAi PolicyData Science
Crusoe

Sourcing Specialist

Supports sourcing strategies and end-to-end procurement for corporate services like IT, Finance, Legal, HR. Requires 2-3 years experience, bachelor's degree, analytical skills, and familiarity with P2P systems.

89k – 101kDenver, COOtherOn-site2+ YOEZipCoupa