[Remote] Senior Backend Engineer, AI Engineering: Chat
Note: The job is a remote job and is open to candidates in USA. GitLab is the intelligent orchestration platform for DevSecOps, enabling organizations to increase developer productivity and improve operational efficiency. As a Senior Backend Engineer on the Duo Chat team, you will build core AI capabilities for GitLab Duo Chat, integrating large language models and orchestrating multi-agent flows to enhance the software development lifecycle.
Responsibilities
- Design and build flow components and agentic flows in the Flow Registry using Python and LangGraph within the Duo Workflow Service. These reusable building blocks power agentic Duo Chat and, increasingly, other AI features across GitLab
- Develop, ship, and maintain backend features for GitLab Duo Chat across the Python Duo Workflow Service and the GitLab Rails monolith in a secure, well-tested, and performant way
- Integrate new generative AI models, providers, tools, and multi-agent orchestration patterns into Duo Chat to expand its capabilities and improve answer quality
- Design, implement, and review GraphQL and Representational State Transfer (REST) application programming interfaces (APIs) and related monolith logic, including chat entry points, permissions, and foundational-flow registration. Keep contracts with frontend clients and host systems reliable and clear
- Improve debugging, observability, and test coverage using pytest, RSpec, and related frameworks; track and improve latency, error rates, and test coverage so AI-powered chat workflows stay reliable at scale
- Collaborate with Product, User Experience (UX), frontend, and AI specialists to refine requirements and deliver high-quality improvements through iteration
- Document standards, patterns, and learnings with other engineers, raising the bar for safe AI integration and evidence-driven engineering
- Participate in Tier 2 on-call rotations to troubleshoot production issues, contribute to root cause analysis, and strengthen resiliency
Skills
- Significant experience building and maintaining production Python backends, including APIs, data models, and asynchronous or long-running worklo
- Practical experience designing and shipping AI-powered, agentic backend features, including large language model integration, tool or function calling, and multi-agent orchestration. You use sound judgment about large language model limitations and safe use in production
- Working proficiency in Ruby on Rails, or a strong willingness to learn it. Duo Chat integrates deeply with the GitLab monolith for chat entry points, GraphQL, permissions, and flow registration, and most of GitLab's codebase is written in Ruby
- Proficiency designing or extending REST or GraphQL APIs with attention to scalability, maintainability, and backward compatibility
- Strong Structured Query Language (SQL) skills and familiarity with relational databases such as PostgreSQL, including efficient queries and data modeling
- Ability to find, diagnose, and prevent performance and reliability problems at scale
- Experience solving technical problems of high scope and complexity and advocating for quality, security, and performance improvements across your team
- Openness to learning and collaborating in an async-first, distributed team, applying transferable skills from related technologies or domains
- Hands-on experience with agent frameworks such as LangGraph or LangChain is a strong plus
Benefits
- Benefits to support your health, finances, and well-being
- Flexible Paid Time Off (PTO)
- Team Member Resource Groups (TMRG/TMAG)
- Equity Compensation & Employee Stock Purchase Plan
- Growth and Development Fund
- Parental Leave
Company Overview