Senior Backend Engineer, AI Engineering: Chat

Responsibilities

• Design and build flow components and agentic flows in the Flow Registry using Python and LangGraph within the Duo Workflow Service.
• Develop, ship, and maintain backend features for GitLab Duo Chat across the Python Duo Workflow Service and GitLab Rails monolith.
• Integrate generative AI models, providers, tools, and multi-agent orchestration patterns into Duo Chat.
• Design, implement, and review GraphQL and REST APIs, including chat entry points, permissions, and foundational-flow registration.
• Improve debugging, observability, and test coverage using pytest, RSpec, and related frameworks.
• Track and improve latency, error rates, and test coverage for AI-powered chat workflows.
• Collaborate with Product, UX, frontend, and AI specialists to refine requirements and deliver improvements.
• Document engineering standards, patterns, and learnings.
• Participate in Tier 2 on-call rotations, troubleshoot production issues, and contribute to root cause analysis.

Requirements

• Significant experience building and maintaining production Python backends, including APIs, data models, and asynchronous or long-running workloads.
• Experience designing and shipping AI-powered, agentic backend features, including large language model integration, tool or function calling, and multi-agent orchestration.
• Working proficiency in Ruby on Rails, or strong willingness to learn it.
• Proficiency designing or extending REST or GraphQL APIs with attention to scalability, maintainability, and backward compatibility.
• Strong SQL skills and familiarity with relational databases such as PostgreSQL, including efficient queries and data modeling.
• Ability to diagnose and prevent performance and reliability problems at scale.
• Experience solving technical problems of high scope and complexity and advocating for quality, security, and performance improvements.
• Openness to learning and collaborating in an async-first, distributed team.

Nice to Have

• Hands-on experience with agent frameworks such as LangGraph or LangChain.

Compensation and Benefits

• Flexible paid time off.
• Team member resource groups.
• Equity compensation and employee stock purchase plan.
• Growth and development fund.
• Parental leave.