Remote Senior AI Backend Engineer - LLM & Agentic

GitLab Inc.; United States; Remote; USD 150,000 - 200,000; Full time

Benefits offered by this job

Equity (stock options + ESPP)

Flexible PTO

Async-first culture

Public handbook

Job summary

GitLab Inc. is seeking a Senior AI Backend Engineer focused on Duo Chat and agentic AI capabilities. You will design flow components, integrate large language models, and scale Python backends with Rails integration in a remote-first, async-enabled environment.

You'll collaborate with AI, product, and UX teams to deliver reliable, secure AI-powered workflows across the GitLab platform, while balancing performance, safety, and developer experience.

Qualifications

• Significant experience building production Python backends with APIs and async workloads.
• Practical experience deploying AI-powered backend features, LLM integration, and multi-agent orchestration.
• Proficiency with Ruby on Rails or willingness to learn it, plus Rails monolith integration.

Responsibilities

• Design and build flow components and agentic flows in Flow Registry and Duo Workflow Service.
• Develop, ship, and maintain backend features for GitLab Duo Chat across Python and Rails components.
• Integrate generative AI models, tools, and multi-agent orchestration into Duo Chat for improved answers.

Skills

Python backend

Ruby on Rails

LangGraph

LangChain

GraphQL

REST APIs

PostgreSQL

distributed systems

async programming

on-call resilience

Tools

pytest

RSpec

LangGraph

Job description

GitLab Inc. is seeking a Senior AI Backend Engineer focused on Duo Chat and agentic AI capabilities. You will design flow components, integrate large language models, and scale Python backends with Rails integration in a remote-first, async-enabled environment.

You'll collaborate with AI, product, and UX teams to deliver reliable, secure AI-powered workflows across the GitLab platform, while balancing performance, safety, and developer experience.