Skip to content
FloQastFloQastSan Jose, CA

Senior Software Engineer, Core AI

Senior Software Engineer building and scaling production AI products including chatbots, document processing, and agentic workflows for an accounting automation platform.

Salary not listed
Hybrid7+ YOEML Engineering

About the role

What You'll Do

  • Contribute to the architecture and lead development of production AI products including intelligent chatbots, document processing systems, and agentic workflows using Python and modern AI frameworks
  • Design and implement components of our centralized AI platform including model routing, provider management, vector search, and AI application frameworks with seamless MCP (Model Context Protocol) integrations
  • Build scalable AI products that integrate with diverse technologies including accounting systems, document repositories, and external APIs while maintaining robust monitoring and observability
  • Implement context engineering and system design for AI applications, ensuring optimal information retrieval, context assembly, and multi-turn conversation management
  • Collaborate with Product, Engineering, and Security teams to ensure AI products are robust, compliant, and aligned with business objectives in the regulated accounting space
  • Provide technical guidance and mentorship to other engineers on the growing AI team, promoting best practices for AI product development, deployment, and governance

What You'll Bring

  • 7+ years of professional software engineering experience with 3+ years focused on building backend for production applications
  • Strong proficiency in Python, alongside familiarity with AI application frameworks, context engineering, and scalable system design for AI products
  • Experience designing products that integrate with multiple technologies, APIs, and data sources in cloud-native environments (AWS preferred)
  • Strong desire to develop deep hands-on experience with LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations
  • Proven ability to own tech product initiatives, drive technical standards, and communicate complex system designs to both technical and business stakeholders

Nice To Haves

  • Experience building chatbots or conversational AI products in production
  • Background in system integration, API design, or enterprise software platforms
  • Familiarity with accounting workflows and financial data processing
  • Experience with AI observability, debugging tools, and production AI monitoring
  • Hands-on experience with advanced RAG architectures, reranking systems, and retrieval optimization techniques
  • Knowledge of reinforcement learning from human feedback (RLHF) or other RL techniques for improving AI product performance
  • Experience building AI platform components like embedding pipelines, semantic search systems, or multi-modal processing frameworks

Skills

PythonAWSLLM APIsRAGVector SearchContext EngineeringConversational AIDocument ProcessingMcp IntegrationsAi Observability

Similar roles

ML Engineering jobs
Scale AI

Senior Machine Learning Engineer, Agent Oversight

Scale AISan Francisco, CA +1

Senior ML Engineer building observability, evaluation frameworks, and improvement loops for production agentic AI systems. Requires 5+ years production ML/LLM experience, strong grounding in agent design or evaluation, and hands-on work taking systems from prototype to scale.

216k – 270k/yr
On-site5+ YOEML Engineering
Scale AI

Senior Software Engineer, Agent Oversight

Scale AISan Francisco, CA +1

Build platform infrastructure for observing, evaluating, and improving production AI agents at scale. Requires 4+ years software engineering experience with ML/LLM systems, strong backend/distributed systems skills, and collaboration with ML engineers.

216k – 270k/yr
On-site5+ YOEML Engineering
Ambient.ai

Senior Software Engineer, AI Infrastructure

Ambient.aiRedwood City, CA

Build and optimize scalable AI infrastructure for real-time inference, evaluation, and continuous improvement of LLMs, LVMs, computer vision, and multimodal models on large-scale video data. Requires 4+ years production ML systems experience, strong Python skills, and expertise in inference optimization and model serving.

168k – 205k/yr
Hybrid4+ YOEML Engineering
SpotOn

Senior Software Engineer

SpotOnChicago, IL +3

Senior AI Engineer building agentic workflows and orchestration layers to automate manual business processes for operations, sales, and customer support teams. Requires 7+ years software engineering experience, production LLM/agent expertise, and strong Python/TypeScript skills.

160k – 190k/yr
Hybrid7+ YOEML Engineering
Snowflake

Senior AI Engineer, Enterprise

SnowflakeMenlo Park, CA

Senior AI Engineer building scalable backend services, distributed systems, and reusable AI platform components (agent frameworks, evaluation pipelines, SDKs) that power Snowflake's internal agentic applications for GTM teams. Requires 5+ years software engineering experience, strong Python/FastAPI skills, and production LLM experience.

156k – 224k/yr
On-site5+ YOEML Engineering