Senior Backend Engineer - AI Gateway & LLM Platform

Grab; Petaling Jaya; On-site; MYR 180,000 - 300,000; Full time

Benefits offered by this job

Term Life Insurance

Medical Insurance

GrabFlex

Parental Leave

Birthday Leave

LASA volunteering leave

Grabber Assistance Programme

Job summary

Grab, Southeast Asia's leading superapp, seeks a Senior Software Engineer for the Applied AI Team to power GrabGPT Gateway, the unified LLM API gateway. You will build scalable backend services in Go and Python, enabling secure, cost-accountable access to 60+ models across providers, with routing, auth, rate limits and observability.

Based onsite in Petaling Jaya, you will own gateway features end-to-end, design multi-provider routing, manage CI/CD and cloud deployments, and mentor juniors,

Qualifications

• 3+ years of professional software development experience.
• Proficiency in Go and Python.
• Hands-on experience with LLMs, LangChain and LangGraph.
• Experience with AWS, Kubernetes, and CI/CD pipelines.
• Understanding of data structures, algorithms and distributed systems.
• Advocate for automated testing and concise technical documentation.
• Experience with MySQL, PostgreSQL or Oracle.

Responsibilities

• End-to-end development of gateway features: provider integrations, unified API, model onboarding, API key and identity management, rate limiting, tiering, cost tracking.
• Design multi-provider LLM routing systems translating a unified API into provider-native formats with SSE streaming and fallbacks.
• Build scalable backends in Go and Python for a low-latency gateway handling all LLM traffic.
• Implement reliability and governance layers: rate limiting, authentication, token usage logging, cost computation and chargeback pipelines.
• Manage CI/CD and cloud resources (AWS/GCP/Azure), Kubernetes, migrations and environment configurations.
• Champion test-driven development and mentor junior engineers for reliability, security and cost accountability.
• Participate in on-call rotations and lead post-mortems for Tier-critical services.

Skills

Go

Python

LangChain

LangGraph

AWS

Kubernetes

CI/CD

Distributed systems

Testing

Documentation

Relational DB

Job description

Grab, Southeast Asia's leading superapp, seeks a Senior Software Engineer for the Applied AI Team to power GrabGPT Gateway, the unified LLM API gateway. You will build scalable backend services in Go and Python, enabling secure, cost-accountable access to 60+ models across providers, with routing, auth, rate limits and observability.

Based onsite in Petaling Jaya, you will own gateway features end-to-end, design multi-provider routing, manage CI/CD and cloud deployments, and mentor juniors,