Staff Backend Engineer (Python), Ai Engineering : Agent Foundations

Gitlab; Cape Town; Remote; ZAR 300 000 - 400 000; Full time

Job summary

A leading software development company based in Cape Town is seeking a Staff Backend Engineer (Python). You will lead the core AI service, build scalable web platforms, and drive technical decisions. The ideal candidate has extensive experience with Python web services and AI technologies, contributing to both development and mentorship across teams. This full-time role offers remote work opportunities and various employee benefits.

Benefits

Flexible Paid Time Off

Equity Compensation

Home office support

Growth and Development Fund

Parental leave

Qualifications

• Multiple years of experience building Python web services in a multi-service environment.
• Strong experience with AI / ML technologies, including integration with large language models.
• Ability to work effectively across different technology stacks and learn new languages quickly.

Responsibilities

• Write high-quality, efficient, and maintainable code.
• Build a scalable web platform based on Python and gRPC.
• Provide technical mentorship and influence product decisions.

Skills

Python web services

AI / ML technologies

Performance optimization

Distributed systems

gRPC

Technical mentorship

Verbal communication

Tools

FastAPI

Starlette

Go

TypeScript

Ruby

Job description

Staff Backend Engineer (Python), AI Engineering : Agent FoundationsatGitLab

GitLab is an open-core software company that develops the most comprehensive AI-powered DevSecOps Platform, used by more than , organizations.

We build tools that unify teams and organizations, breaking down barriers and redefining what's possible in software development.

Our platform enables everyone to contribute to and co-create the software that powers our world.

The Agent Foundations group focuses on developing Agent Utilities and Flows – an AI system to automate tasks and increase productivity in the development workflow.

As the Staff Backend Engineer, you'll lead the core service that hosts and coordinates our AI agents, enabling teams inside and outside GitLab to build their own agents.

You'll ensure the service follows up-to-date best practices, orchestrate communication via gRPC, and contribute to core AI functionality.

What You'll Do

Write high-quality, efficient, and maintainable code while adhering to best practices and contributing to code reviews.

Build a highly scalable web platform based on Python and gRPC that can be deployed in different environments.

Design and develop interactions with the latest large language models.

Contribute to a testing infrastructure that verifies agentic AI behaviours.

Embrace continuous learning and stay connected with industry best practices, tools, and technologies around AI to drive improvements in our software.

Provide technical mentorship and guidance to engineers across the Code Creation team and collaborate with other teams.

Influence product and engineering decisions by proposing thorough, iterative solutions to complex technical and architectural challenges.

Collaborate with cross-functional teams across product, engineering, marketing, and more.

Represent the team in technical discussions with customers and stakeholders about AI-powered development capabilities.

Participate in on-call rotations (Tier 2 or Tier 3, weekdays, weekends, and occasional nights) to assist with troubleshooting product operations, security operations, and urgent engineering issues.

What You'll Bring

A deep interest in how AI will change the process of software development.

Multiple years of experience building Python web services in a multi-service environment (e.g., FastAPI, Starlette).

Proven ability to architect and lead complex technical projects from concept to production across distributed systems.

Strong experience with AI / ML technologies, including integration with large language models and prompt engineering.

Deep expertise in performance optimization for high-volume API requests.

Experience designing and building distributed systems with a focus on reliability, observability, and scalability.

Demonstrated ability to drive technical decisions and influence engineering strategy across multiple teams.

Experience mentoring engineers and raising the technical capabilities of a team.

Excellent written and verbal communication skills for collaborating in a remote, globally distributed environment.

Ability to work effectively across different technology stacks and quickly learn new languages and frameworks as needed.

Experience with the gRPC framework is a plus.

Experience with Go, TypeScript, Ruby, or IDE extension development is a plus.

About The Team

The Agent Foundations group is distributed across three continents, unified by a desire to shape the future of software engineering.

We're building the product and infrastructure that change development processes and create the tools of tomorrow.

We partner with teams both within the AI space and across GitLab to ensure that the Duo Agent Platform becomes the backbone of many AI features at GitLab.

How GitLab Will Support You

Benefits to support your health, finances, and well-being.

Flexible Paid Time Off.

Team Member Resource Groups.

Equity Compensation & Employee Stock Purchase Plan.

Growth and Development Fund.

Parental leave.

Home office support.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Engineering and Information Technology

Country hiring guidelines

GitLab hires new team members around the world.

All roles are remote, but some may carry specific location-based eligibility requirements.

Our Talent Acquisition team can help answer any questions about location after you start the recruiting process.

Privacy Policy

Please review our Recruitment Privacy Policy. Your privacy is important to us.

Equal Employment Opportunity

GitLab is a proud equal-opportunity workplace and an affirmative action employer.

Our policies and practices relating to recruitment, employment, career development and advancement, promotion, and retirement are based solely on merit, regardless of race, color, religion, ancestry, sex, gender identity, sexual orientation, national origin, age, citizenship, marital status, disability, genetic information, protected veteran status, or any other basis protected by law.

GitLab will not tolerate discrimination or harassment based on these characteristics.

See also GitLab's EEO Policy and EEO is the Law.

If you have a disability or special need that requires accommodation, please let us know during the recruiting process.