Senior Backend Engineer, AI Engineering: Chat

Job summary

Responsibilities

As a Senior Backend Engineer on the Duo Chat team, focused on Chat Engine, you'll build the core AI capabilities behind GitLab Duo Chat, the natural-language and agentic interface to the GitLab DevSecOps platform.

• Design and build flow components and agentic flows in the Flow Registry using Python and LangGraph within the Duo Workflow Service.
• Develop, ship, and maintain backend features for GitLab Duo Chat across the Python Duo Workflow Service and the GitLab Rails monolith in a secure, well-tested, and performant way.
• Integrate new generative AI models, providers, tools, and multi-agent orchestration patterns into Duo Chat to expand its capabilities and improve answer quality.
• Design, implement, and review GraphQL and Representational State Transfer (REST) application programming interfaces (APIs) and related monolith logic, including chat entry…
• Improve debugging, observability, and test coverage using pytest, RSpec, and related frameworks; track and improve latency, error rates, and test coverage so AI-powered chat…

What they're looking for

• Significant experience building and maintaining production Python backends, including APIs, data models, and asynchronous or long-running workloads.
• Practical experience designing and shipping AI-powered, agentic backend features, including large language model integration, tool or function calling, and multi-agent…
• Working proficiency in Ruby on Rails, or a strong willingness to learn it. Duo Chat integrates deeply with the GitLab monolith for chat entry points, GraphQL, permissions, and…
• Proficiency designing or extending REST or GraphQL APIs with attention to scalability, maintainability, and backward compatibility.
• Strong Structured Query Language (SQL) skills and familiarity with relational databases such as PostgreSQL, including efficient queries and data modeling.

Tech stack

• Python
• LangGraph
• SQL
• PostgreSQL
• LangChain