Senior Software Engineer, Backend (AI)

GrabTaxi Holdings Pte. Ltd.; Petaling Jaya; On-site; MYR 180,000 - 240,000; Full time

Benefits offered by this job

Term Life Insurance

Medical Insurance

GrabFlex benefits package

Parental leave

Birthday leave

Grabber Assistance Programme

Job summary

Grab is seeking a Senior Software Engineer to join the Applied AI Team, serving as the technical backbone of the GrabGPT Gateway. You’ll build secure, scalable gateway services that route 60+ models from providers like OpenAI and Google Vertex AI, enforce authentication, and track usage and costs.

This role sits onsite at the Grab office in Petaling Jaya, Malaysia. You will own multi-provider routing, cost-aware capacity management, and observability, collaborating with teams to enable AI

Qualifications

• 3+ years of professional software development experience.
• Proficiency in server-side programming (Go and Python).
• Hands-on experience with LLMs and related tooling.
• Cloud, containerization and CI/CD experience.
• Strong understanding of data structures and distributed systems.
• Experience with relational databases.

Responsibilities

• Develop gateway features end-to-end: provider integrations, unified API endpoints, model onboarding, API key and identity management, rate limiting, tiering, and cost tracking.
• Design multi-provider LLM routing systems with OpenAI-compatible API surfaces.
• Build scalable backends in Go and Python for low-latency LLM traffic gateway.
• Operate platform reliability, governance layers, rate limiting, authentication, and cost tracking pipelines.
• Manage CI/CD and cloud resources across staging and production, including migrations to EKS.
• Advocate for test-driven development and mentor junior engineers.
• Ensure system reliability for a Tier-critical service and participate in on-call rotations.

Skills

Go (Golang)

Python

LLMs

LangChain

LangGraph

AWS

Kubernetes

CI/CD

Data structures

Automated testing

Tools

MySQL

PostgreSQL

Oracle

Job description

About Grab and Our Workplace

Grab is Southeast Asia's leading superapp. From getting your favourite meals delivered to helping you manage your finances and getting around town hassle-free, we've got your back with everything. In Grab, purpose gives us joy and habits build excellence, while harnessing the power of Technology and AI to deliver the mission of driving Southeast Asia forward by economically empowering everyone, with heart, hunger, honour, and humility.

Get to Know the Team

Applied AI Team is a group of passionate engineers committed to architecting, crafting, and maintaining internal tooling systems, frameworks and platforms that elevate the very core of our business operations. With unyielding, we create functional applications that not only enhance productivity but also redefine efficiency for Grab employees. Join us in this journey of as we pioneer the future of technology, pushing the boundaries of what's possible to shape Grab's success.

Get to Know the Role

As a Senior Software Engineer on our team, you will be the technical backbone of the AI Gateway (GrabGPT Gateway) — Grab's unified LLM API gateway and the single integration point through which every AI initiative in the organization accesses large language models. You will build the systems that give teams secure, reliable, and cost-accountable access to 60+ models across providers such as OpenAI, Anthropic, Google Vertex AI, etc: routing and proxying requests, enforcing authentication and rate limits, streaming responses, tracking token usage and cost, and onboarding new models and providers as the LLM landscape evolves.

You will own scalable, high-throughput gateway services and the platform capabilities that power them, model routing, tiered capacity management, chargeback, and observability, for a service that sits in the critical path of all LLM traffic at Grab.

You will report to the Engineering Manager and work onsite at the Grab Office.

This role is onsite based in our Petaling Jaya, Malaysia office.

The Critical Tasks You Will Perform

• You will manage gateway features end-to-end. Independently build complex backend features — provider integrations, unified API endpoints, model onboarding, API key and identity management, rate limiting, tiering, and cost tracking, from conception through deployment.
• You will design multi-provider LLM routing systems that translate a unified, OpenAI-compatible API surface into provider-native formats, with support for SSE streaming, automatic fallback, and provider-specific capabilities.
• You will build scalable, well-architected backends in Go and Python where appropriate for a low-latency reverse-proxy service handling all LLM traffic at Grab, following clean service-layer patterns and consistent API conventions.
• You will build and operate the platform's reliability and governance layers: distributed rate limiting and tiered capacity isolation on Redis, API key and OIDC/workload-identity authentication, and token-level usage logging, cost computation, and chargeback pipelines integrated with PostgreSQL and the data lake.
• You will manage CI/CD and cloud resources (AWS/GCP/Azure), Kubernetes deployments, database migrations, and configuration across staging and production environments, including platform migrations such as moving the gateway to Grab's standardized EKS stack.
• You will champion test-driven development and "shift-left" quality. Write tests first, mentor junior engineers, and foster a platform-thinking culture so that reliability, cost accountability, and security are designed in, not bolted on.
• You will ensure system reliability for a Tier-critical service. Participate in on-call rotations, manage provider capacity and quota incidents, conduct root cause analysis, and lead post-mortems.

What Essential Skills You Will Need

• 3+ years of professional software development experience with a history of delivering successful solutions.
• Proficiency in server-side programming, specifically Go (Golang) and Python.
• Hands-on experience with LLMs (Large Language Models), LangChain, and LangGraph for conversational AI development.
• Practical experience with cloud providers (AWS), containerization (Kubernetes), and CI/CD pipelines.
• Grasp of data structures, algorithms, distributed systems, and multi-threading.
• An advocate for automated testing (unit, integration) and writing concise technical documentation.
• Experience with a relational database such as MySQL, PostgreSQL, or Oracle

Life at Grab

We care about your well-being at Grab, here are some of the global benefits we offer:

• We have your back with Term Life Insuranceand comprehensive Medical Insurance.
• With GrabFlex, create a benefits package that suits your needs and aspirations.
• Celebrate moments that matter in life with loved ones through Parental and Birthday leave, and give back to your communities through Love-all-Serve-all (LASA) volunteering leave
• We have a confidential Grabber Assistance Programme to guide and uplift you and your loved ones through life's challenges.

What We Stand For at Grab

We are committed to building an inclusive and equitable workplace that enables diverse Grabbers to grow and perform at their best. As an equal opportunity employer, we consider all candidates fairly and equally regardless of nationality, ethnicity, religion, age, gender identity, sexual orientation, family commitments, physical and mental impairments or disabilities, and other attributes that make them unique.