# Staff Software Engineer, Core AI

**Company:** [FloQast](https://hotfix.jobs/companies/floqast)
**Location:** San Jose, CA
**Role:** ML Engineering
**Experience:** 10+ years
**Skills:** Python, Ai Frameworks, AWS, LLM APIs, Retrieval-Augmented Generation, Conversational AI, Vector Search, Model Routing, Mcp, API Design, System Design, Ai Observability, Semantic Search, Document Processing, Reinforcement Learning
**Posted:** 2025-10-07

> Leads the architecture and development of production AI products and the centralized platform supporting them, including agentic workflows, retrieval, and integrations. Requires 10+ years of software engineering experience, deep Python expertise, and strong production AI and technical leadership capabilities.

## Job Description

## Responsibilities
- Architect and lead production AI products, including intelligent chatbots, document processing systems, and agentic workflows.
- Design and implement a centralized AI platform with model routing, provider management, vector search, AI application frameworks, and MCP integrations.
- Build scalable AI products integrating accounting systems, document repositories, external APIs, and other data sources.
- Establish robust monitoring, observability, deployment, and governance practices for AI products.
- Apply context engineering and system design to optimize information retrieval, context assembly, and multi-turn conversations.
- Collaborate with Product, Engineering, and Security teams on robust, compliant AI products.
- Provide technical leadership and mentorship while establishing AI development standards.

## Requirements
- 10+ years of professional software engineering experience, including 4+ years building backend production applications.
- Mastery of Python.
- Familiarity with AI application frameworks, context engineering, and scalable AI system design.
- Experience designing products integrating multiple technologies, APIs, and data sources in cloud-native environments.
- Ability to lead technical product initiatives, establish standards, and communicate complex designs to technical and business stakeholders.

## Nice to Have
- Production experience with chatbots or conversational AI.
- Experience with system integration, API design, or enterprise software platforms.
- Familiarity with accounting workflows and financial data processing.
- Experience with AI observability, debugging tools, and production AI monitoring.
- Experience with advanced RAG architectures, reranking, and retrieval optimization.
- Knowledge of reinforcement learning from human feedback or other reinforcement learning techniques.
- Experience building embedding pipelines, semantic search systems, or multimodal processing frameworks.
- Experience with LLM APIs, retrieval-augmented generation, document processing, and MCP integrations.
- AWS experience is preferred.

## Similar jobs

- [Staff Machine Learning Engineer, Public Sector](https://hotfix.jobs/jobs/cc2e220a-79df-4631-ad6e-46ac6902953f) - Scale AI - Denver, CO - $274k – $343k/yr
- [Staff Machine Learning Engineer, Home Surfaces](https://hotfix.jobs/jobs/6b5a1e49-1cb9-4169-aa1d-1febb750d4a8) - Spotify - Remote
- [Staff+ Software Engineer, ML Inference Path](https://hotfix.jobs/jobs/90cf7427-87de-41e1-af88-0d4e1187b94b) - Anthropic - San Francisco, CA - $320k – $485k/yr
- [Staff Engineer, Perception Software](https://hotfix.jobs/jobs/f7fd4093-6de3-4fa2-a6af-4195c25747f0) - Shield AI - San Diego, CA - $200k – $300k/yr
- [Staff Machine Learning Operations Engineer](https://hotfix.jobs/jobs/b5d46280-8221-4b6e-b0b2-033cc6f2c8d7) - Garner Health - New York, NY - $298k – $351k/yr

**Apply:** https://hotfix.jobs/jobs/319cca46-06a8-41a1-8032-f72a7b4998ee
**Canonical:** https://hotfix.jobs/jobs/319cca46-06a8-41a1-8032-f72a7b4998ee