Senior/Staff Backend Engineer, Applied AI
Senior/Staff Backend Engineer building and scaling AI-driven products including MCP tools, agent orchestration, evaluations, and observability for non-deterministic LLM systems on a Django backend.
About the job
Key Responsibilities
- Partner with the team’s Product Manager and Designer to define and prioritize Fora’s Applied AI roadmap, turning ambiguous goals into shippable agent capabilities
- Help design and build our MCP tooling – exposing Fora’s data and service layers through permission-aware MCP tools that agents can call on an advisor's behalf, with the proper guardrails in place so that we only ever act on the right data at the right time
- Build and harden our agent orchestration – tool-calling loops, streaming responses, multi-step workflows, retries and guardrails, and the contracts between Fora’s advisor portal and the AI service
- Continue improving the reliability of a non-deterministic system by designing evals, regression suites, tracing, and logging event metrics so we can measure quality, catch tool-call drift, and ship prompt, model, and tool changes with less risk
- Focus on performance, latency, architecture, and clean code – advisors feel every millisecond of a streamed response and every wrong tool call
- Collaborate with engineers across the company to define end-to-end solutions that span the AI services, the core Django platform, and our portal frontend
- Take features from 0 → 1, owning an entire solution from design to implementation to delivery and beyond
- Help establish the patterns, primitives, and best practices for Applied AI at Fora as the teams surface area grows
Requirements
- Bachelor's Degree in Computer Science, or equivalent practical experience
- 5+ years experience in backend web development
- 3+ years experience with Python, using Django / Flask / Alternative
- High API and distributed-systems design skills, with strong fundamentals in relational databases and ORMs
- Genuine curiosity and drive to go deep and stay up to date on applied AI
- Ability to be a team player, with strong communication and collaboration skills
- An entrepreneurial mindset and comfort with ambiguity and fast iteration
Strongly Preferred
- Hands-on experience shipping LLM-powered features in production: MCP tools, agentic loops, structured outputs, streaming (SSE), prompt design, retrieval, evals
- Familiarity with the modern agent stack: the Model Context Protocol (MCP), LLM provider SDKs (e.g., Anthropic, OpenAI), and agent / eval frameworks
- Experience designing evaluation and observability for non-deterministic AI systems (offline evals, LLM-as-judge, tracing, prompt / version tracking)
- Daily use of AI coding tools as part of how you build
- Experience with async task and streaming infrastructure (Celery, RabbitMQ, or similar)
- AWS experience
- Kubernetes experience
Compensation & Benefits
- Indicative range of $155K–$225K + equity
- Unlimited vacation
- Health Insurance (including an option completely covered by Fora HQ)
- Dental & Vision Insurance
- Wellhub Memberships
- 401k plan with company match
- Commuter Benefits
- Supplemental Life Insurance
- Stock Options
Skills
Python, Django, Flask, LLMs, Mcp, Agentic Workflows, Prompt Engineering, Evals, AWS, Kubernetes, Celery, RabbitMQ, Streaming, Sse, Distributed Systems, Relational Databases
Similar jobs
Backend Engineering jobsBuild and operate Go-based automation and a PostgreSQL-as-a-service platform for high-throughput, always-on production systems. The role requires deep PostgreSQL production experience, backend development expertise, infrastructure automation, and staff-level technical leadership.
Provides cross-team technical leadership for large backend initiatives, modular architecture, production operations, and AI-assisted engineering adoption. The role requires deep backend architecture experience, monolith modernization expertise, strong written influence, and mentoring ability.
Staff-level engineer shaping the architecture and technical direction of MongoDB’s Search and Vector Search infrastructure. The role requires 10+ years in data management or distributed infrastructure, strong distributed-systems expertise, and the ability to lead complex cross-team initiatives.
Architects and leads development of Kong Identity’s globally distributed, multi-tenant identity platform, including token management, federation, security, compliance, and developer tooling. Requires 7+ years building production identity systems and deep expertise in modern identity protocols and high-scale infrastructure.
Technical leader for the Metadata team, designing distributed cloud subsystems and leading complex initiatives across discovery, catalog, lineage, and run history services. Requires 8+ years of software engineering experience, backend or systems expertise, cloud infrastructure experience, and strong architecture, reliability, and mentoring skills.