Staff Software Engineer, AI
Leads the architecture and development of production AI products and a centralized AI platform for accounting automation. The role requires deep Python and backend engineering expertise, scalable system design, and experience with LLM applications, RAG, integrations, and technical leadership.
About the job
Responsibilities
- Architect and lead development of production AI products, including intelligent chatbots, document processing systems, and agentic workflows using Python and modern AI frameworks.
- Design and implement a centralized AI platform with model routing, provider management, vector search, AI application frameworks, and seamless MCP integrations.
- Build scalable AI products integrating with accounting systems, document repositories, and external APIs while maintaining robust monitoring and observability.
- Apply context engineering and system design to optimize information retrieval, context assembly, and multi-turn conversation management.
- Collaborate with Product, Engineering, and Security teams to ensure AI products are robust, compliant, and aligned with business objectives.
- Provide technical leadership and mentorship, establishing best practices for AI product development, deployment, and governance.
Requirements
- 10+ years of professional software engineering experience, including 4+ years building backend production applications.
- Mastery of Python.
- Familiarity with AI application frameworks, context engineering, and scalable system design for AI products.
- Expertise designing products that integrate multiple technologies, APIs, and data sources in cloud-native environments; AWS preferred.
- Hands-on experience or strong interest in LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations.
- Ability to lead technical product initiatives, establish technical standards, and communicate complex system designs to technical and business stakeholders.
Nice to Haves
- Experience building production chatbots or conversational AI products.
- Background in system integration, API design, or enterprise software platforms.
- Familiarity with accounting workflows and financial data processing.
- Experience with AI observability, debugging tools, and production AI monitoring.
- Hands-on experience with advanced RAG architectures, reranking systems, and retrieval optimization.
- Knowledge of reinforcement learning from human feedback (RLHF) or other reinforcement learning techniques.
- Experience building AI platform components such as embedding pipelines, semantic search systems, or multimodal processing frameworks.
Skills
Python, Ai Frameworks, AWS, LLM APIs, RAG, Conversational AI, Document Processing, Mcp, Vector Search, API Design, Ai Observability, Semantic Search, Embedding Pipelines, Reinforcement Learning, Cloud-Native Systems
Similar jobs
ML Engineering jobs
Databricks
Bengaluru, India
Leads the development of ML- and NLP-powered search relevance systems, including query understanding, ranking, retrieval, and evaluation. Requires 10+ years of search relevance experience and a bachelor’s degree, with advanced study preferred.
Payabli
Remote
Sets the technical direction for production machine learning across a payments platform, building and scaling models for risk, authorization, disputes, and forecasting. Requires 8+ years of ML engineering experience, including production model ownership and strong technical leadership.
GitLab
Bengaluru, India
Build and ship autonomous, agentic software development lifecycle capabilities, including AI agents, orchestration, and safety guardrails. The role requires senior software engineering experience, proficiency in Ruby, Go, or Python, distributed systems knowledge, and experience with AI/ML applications.
Airbnb
Bengaluru, India
Build and operate scalable AI/ML systems and pipelines that strengthen Airbnb’s fraud prevention and trust defenses. The role requires 7+ years of backend or platform engineering experience, strong programming and data engineering skills, and production machine learning expertise.
Together AI
Amsterdam, Netherlands
Build production AI agents and the distributed platform that operates large-scale GPU infrastructure. The role requires 5+ years of backend, distributed systems, or infrastructure experience, with expertise in agent systems, knowledge graphs, retrieval, or semantic search.