Backend Engineer, AI Engineering: Duo Chat
Build and maintain the Python-based agentic runtime powering GitLab Duo Chat, integrate it with GitLab’s Rails monolith and GraphQL APIs, and improve reliability, security, and performance. The role requires production Python experience, API development skills, and familiarity with agent orchestration or LLM systems.
About the job
Responsibilities
- Develop secure, well-tested, and performant features for GitLab Duo Chat.
- Implement and extend agentic flows in Python using LangGraph, registered through the Flow Registry and served by the Duo Workflow Service.
- Integrate Chat capabilities with the GitLab Rails monolith, including its GraphQL API.
- Write maintainable, high-scale code with tests included in every merge request.
- Review code according to Code Review Guidelines and respond to external contributions.
- Identify technical debt and implement improvements to team efficiency.
- Collaborate with Product Management, User Experience, and Frontend teams to improve product quality, security, and performance.
- Participate in Tier 2 or Tier 3 weekday, weekend, and occasional night on-call rotations.
Requirements
- Professional experience with Python, including building and testing production services.
- Working proficiency with Ruby on Rails or willingness to learn it.
- Experience or strong interest in large language model applications, including prompting, tool or function calling, evaluation, and nondeterministic-system failure modes.
- Experience designing and building APIs, diagnosing and optimizing performance issues, and working with documented third-party services.
- Security-minded development practices and secure coding guidelines.
- Clear technical writing and communication in a remote, asynchronous environment.
- Ability to manage work independently, prioritize effectively, and ask for help when needed.
- Experience with LangGraph, LangChain, or a comparable agent orchestration framework.
Nice to Have
- Experience with GraphQL and RSpec.
- Experience using or contributing to GitLab.
- Experience working on a remote, globally distributed team.
Compensation and Benefits
- United States base salary range: $115,200–$194,400 USD.
- Benefits include flexible paid time off, team member resource groups, equity compensation, employee stock purchase plan, growth and development fund, and parental leave.
Skills
Python, Ruby on Rails, LangGraph, LangChain, GraphQL, Rspec, Graphql Api, LLMs, Prompt Engineering, Tool Calling, Flow Registry, Duo Workflow Service, GitLab
Similar jobs
Backend Engineering jobs
GitLab
Bengaluru, India
Build and operate production backend features, APIs, integrations, and services for a large-scale DevSecOps platform. The role requires professional backend development experience, strong database and testing fundamentals, independent feature ownership, and clear asynchronous communication.
GitLab
United StatesBuild and maintain Ruby on Rails backend systems for GitLab’s vulnerability management workflows, including security dashboards, reports, and ingestion pipelines. The role requires backend application experience, PostgreSQL knowledge, technical problem-solving, and effective collaboration in a distributed team.
MongoDB
Canada
Build and improve MongoDB’s low-level networking and observability systems for a distributed database. The role requires production C++ experience, distributed-systems expertise, strong computer science fundamentals, and the ability to lead projects collaboratively from design through delivery.
Lyft
Toronto, Canada
Build scalable backend tools and features that improve trust and safety for Lyft riders and drivers. The role requires 3+ years of software engineering experience, strong Python or Go skills, and experience with distributed systems and concurrency.
Lyft
Toronto, Canada
Build and launch pricing and rider-engagement systems for Lyft’s marketplace, focusing on latency-sensitive distributed systems, concurrency, experimentation, and scalable backend services. The role requires 3+ years of software engineering experience and strong Python or Go skills.