# Staff Software Engineer, AI

**Company:** [FloQast](https://hotfix.jobs/companies/floqast)
**Location:** Pune, India
**Role:** ML Engineering
**Experience:** 10+ years
**Skills:** Python, Ai Frameworks, AWS, LLM APIs, RAG, Conversational AI, Document Processing, Mcp, Vector Search, API Design, Ai Observability, Semantic Search, Embedding Pipelines, Reinforcement Learning, Cloud-Native Systems
**Posted:** 2025-07-09

> Leads the architecture and development of production AI products and a centralized AI platform for accounting automation. The role requires deep Python and backend engineering expertise, scalable system design, and experience with LLM applications, RAG, integrations, and technical leadership.

## Job Description

## Responsibilities
- Architect and lead development of production AI products, including intelligent chatbots, document processing systems, and agentic workflows using Python and modern AI frameworks.
- Design and implement a centralized AI platform with model routing, provider management, vector search, AI application frameworks, and seamless MCP integrations.
- Build scalable AI products integrating with accounting systems, document repositories, and external APIs while maintaining robust monitoring and observability.
- Apply context engineering and system design to optimize information retrieval, context assembly, and multi-turn conversation management.
- Collaborate with Product, Engineering, and Security teams to ensure AI products are robust, compliant, and aligned with business objectives.
- Provide technical leadership and mentorship, establishing best practices for AI product development, deployment, and governance.

## Requirements
- 10+ years of professional software engineering experience, including 4+ years building backend production applications.
- Mastery of Python.
- Familiarity with AI application frameworks, context engineering, and scalable system design for AI products.
- Expertise designing products that integrate multiple technologies, APIs, and data sources in cloud-native environments; AWS preferred.
- Hands-on experience or strong interest in LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations.
- Ability to lead technical product initiatives, establish technical standards, and communicate complex system designs to technical and business stakeholders.

## Nice to Haves
- Experience building production chatbots or conversational AI products.
- Background in system integration, API design, or enterprise software platforms.
- Familiarity with accounting workflows and financial data processing.
- Experience with AI observability, debugging tools, and production AI monitoring.
- Hands-on experience with advanced RAG architectures, reranking systems, and retrieval optimization.
- Knowledge of reinforcement learning from human feedback (RLHF) or other reinforcement learning techniques.
- Experience building AI platform components such as embedding pipelines, semantic search systems, or multimodal processing frameworks.

## Similar jobs

- [Staff Software Engineer - Search Platform](https://hotfix.jobs/jobs/9c9d7c76-3610-4456-81fe-2662b6af213e) - Databricks - Bengaluru, India
- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/2cb6da8f-4a54-448d-a4b6-fc05f1412a12) - Payabli - Remote
- [Senior Software Engineer, NLP](https://hotfix.jobs/jobs/be3f0222-b08a-4620-9ddc-402209ea73f7) - GitLab - Remote
- [Senior Software Engineer , Trust](https://hotfix.jobs/jobs/db6ff47c-2411-4457-a551-f83493a3f865) - Airbnb - Bengaluru, India - ₹4.5M – ₹6.5M/yr
- [Senior Software Engineer — Infra Agent Systems](https://hotfix.jobs/jobs/69ee003d-f12c-4cc6-acf0-f3350576d29e) - Together AI - Remote

**Apply:** https://hotfix.jobs/jobs/db71789e-e968-49e8-82fb-5949ef6dc1e1
**Canonical:** https://hotfix.jobs/jobs/db71789e-e968-49e8-82fb-5949ef6dc1e1