Senior Software Engineer, Backend (AI)

Grab; Petaling Jaya; On-site; MYR 180,000 - 300,000; Full time

Benefits offered by this job

Term Life Insurance

Medical Insurance

GrabFlex

Parental Leave

Birthday Leave

LASA volunteering leave

Grabber Assistance Programme

Job summary

Grab, Southeast Asia's leading superapp, seeks a Senior Software Engineer for the Applied AI Team to power GrabGPT Gateway, the unified LLM API gateway. You will build scalable backend services in Go and Python, enabling secure, cost-accountable access to 60+ models across providers, with routing, auth, rate limits and observability.

Based onsite in Petaling Jaya, you will own gateway features end-to-end, design multi-provider routing, manage CI/CD and cloud deployments, and mentor juniors,

Qualifications

• 3+ years of professional software development experience.
• Proficiency in Go and Python.
• Hands-on experience with LLMs, LangChain and LangGraph.
• Experience with AWS, Kubernetes, and CI/CD pipelines.
• Understanding of data structures, algorithms and distributed systems.
• Advocate for automated testing and concise technical documentation.
• Experience with MySQL, PostgreSQL or Oracle.

Responsibilities

• End-to-end development of gateway features: provider integrations, unified API, model onboarding, API key and identity management, rate limiting, tiering, cost tracking.
• Design multi-provider LLM routing systems translating a unified API into provider-native formats with SSE streaming and fallbacks.
• Build scalable backends in Go and Python for a low-latency gateway handling all LLM traffic.
• Implement reliability and governance layers: rate limiting, authentication, token usage logging, cost computation and chargeback pipelines.
• Manage CI/CD and cloud resources (AWS/GCP/Azure), Kubernetes, migrations and environment configurations.
• Champion test-driven development and mentor junior engineers for reliability, security and cost accountability.
• Participate in on-call rotations and lead post-mortems for Tier-critical services.

Skills

Go

Python

LangChain

LangGraph

AWS

Kubernetes

CI/CD

Distributed systems

Testing

Documentation

Relational DB

Job description

About Grab and Our Workplace

Grab is Southeast Asia's leading superapp. From getting your favourite meals delivered to helping you manage your finances and getting around town hassle-free, we've got your back with everything. In Grab, purpose gives us joy and habits build excellence, while harnessing the power of Technology and AI to deliver the mission of driving Southeast Asia forward by economically empowering everyone, with heart, hunger, honour, and humility.

Get to Know the Team

Applied AI Team is a group of passionate engineers committed to architecting, crafting, and maintaining internal tooling systems, frameworks and platforms that elevate the very core of our business operations. With unyielding, we create functional applications that not only enhance productivity but also redefine efficiency for Grab employees. Join us in this journey of as we pioneer the future of technology, pushing the boundaries of what's possible to shape Grab's success.

Get to Know the Role

As a Senior Software Engineer on our team, you will be the technical backbone of the AI Gateway (GrabGPT Gateway) — Grab's unified LLM API gateway and the single integration point through which every AI initiative in the organization accesses large language models. You will build the systems that give teams secure, reliable, and cost-accountable access to 60+ models across providers such as OpenAI, Anthropic, Google Vertex AI, etc: routing and proxying requests, enforcing authentication and rate limits, streaming responses, tracking token usage and cost, and onboarding new models and providers as the LLM landscape evolves.

You will own scalable, high-throughput gateway services and the platform capabilities that power them, model routing, tiered capacity management, chargeback, and observability, for a service that sits in the critical path of all LLM traffic at Grab.

You will report to the Engineering Manager and work onsite at the Grab Office.

This role is onsite based in our Petaling Jaya, Malaysia office.

The Critical Tasks You Will Perform

• You will manage gateway features end-to-end. Independently build complex backend features — provider integrations, unified API endpoints, model onboarding, API key and identity management, rate limiting, tiering, and cost tracking, from conception through deployment.
• You will design multi-provider LLM routing systems that translate a unified, OpenAI-compatible API surface into provider-native formats, with support for SSE streaming, automatic fallback, and provider-specific capabilities.
• You will build scalable, well-architected backends in Go and Python where appropriate for a low-latency reverse-proxy service handling all LLM traffic at Grab, following clean service-layer patterns and consistent API conventions.
• You will build and operate the platform's reliability and governance layers: distributed rate limiting and tiered capacity isolation on Redis, API key and OIDC/workload-identity authentication, and token-level usage logging, cost computation, and chargeback pipelines integrated with PostgreSQL and the data lake.
• You will manage CI/CD and cloud resources (AWS/GCP/Azure), Kubernetes deployments, database migrations, and configuration across staging and production environments, including platform migrations such as moving the gateway to Grab's standardized EKS stack.
• You will champion test-driven development and "shift-left" quality. Write tests first, mentor junior engineers, and foster a platform-thinking culture so that reliability, cost accountability, and security are designed in, not bolted on.
• You will ensure system reliability for a Tier-critical service. Participate in on-call rotations, manage provider capacity and quota incidents, conduct root cause analysis, and lead post-mortems.

What Essential Skills You Will Need

• 3+ years of professional software development experience with a history of delivering successful solutions.
• Proficiency in server-side programming, specifically Go (Golang) and Python.
• Hands-on experience with LLMs (Large Language Models), LangChain, and LangGraph for conversational AI development.
• Practical experience with cloud providers (AWS), containerization (Kubernetes), and CI/CD pipelines.
• Grasp of data structures, algorithms, distributed systems, and multi-threading.
• An advocate for automated testing (unit, integration) and writing concise technical documentation.
• Experience with a relational database such as MySQL, PostgreSQL, or Oracle

Life at Grab

We care about your well-being at Grab, here are some of the global benefits we offer:

• We have your back with Term Life Insuranceand comprehensive Medical Insurance.
• With GrabFlex, create a benefits package that suits your needs and aspirations.
• Celebrate moments that matter in life with loved ones through Parental and Birthday leave, and give back to your communities through Love-all-Serve-all (LASA) volunteering leave
• We have a confidential Grabber Assistance Programme to guide and uplift you and your loved ones through life's challenges.

What We Stand For at Grab

We are committed to building an inclusive and equitable workplace that enables diverse Grabbers to grow and perform at their best. As an equal opportunity employer, we consider all candidates fairly and equally regardless of nationality, ethnicity, religion, age, gender identity, sexual orientation, family commitments, physical and mental impairments or disabilities, and other attributes that make them unique.