AI Platform Architect: Build a Scalable Model API

GTS Consulting; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

GTS Consulting is seeking a hands-on backend-focused engineer to own the end-to-end build of an AI model service platform. You will architect scalable model APIs, ensure reliable routing and load balancing, and work with cross-functional teams to align the platform with company goals.

Candidates should have strong experience with cloud platforms, microservices, and AI/LLM APIs, and a track record of delivering scalable systems for high user volumes.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• Strong backend development experience in Java, Go, Python, or similar.
• Hands-on experience with cloud platforms (AWS, Azure, GCP, or Alibaba Cloud).
• Experience with microservices architecture and API design.
• Familiarity with AI/LLM APIs (OpenAI, Anthropic, Qwen, etc.) and inference frameworks.
• Experience building systems that scale to high user volumes.
• Understanding of load balancing, service routing, and distributed systems.
• Good communication skills; able to work with cross-functional teams.

Responsibilities

• Own the end-to-end build of an AI model service platform, starting from zero, engineered to grow into a system that can reliably serve user bases in the hundreds of thousands to millions.
• Architect and scale a unified layer of model API interfaces, managing request routing, load balancing, and platform expansion while ensuring reliability.
• Deep working knowledge of today’s leading AI models and their APIs.
• Solid backend development skills, with cloud deployment, microservices, and inference frameworks, and the ability to scale production systems.
• Collaborate with Agent teams, hardware teams, and other functions to align platform direction with company goals.

Skills

Backend development

Java

Go language

Python

API design

Cloud platforms

Distributed systems

Education

Bachelor's degree in CS/SE

Tools

AWS

Azure

GCP

Alibaba Cloud

Kubernetes

Job description

GTS Consulting is seeking a hands-on backend-focused engineer to own the end-to-end build of an AI model service platform. You will architect scalable model APIs, ensure reliable routing and load balancing, and work with cross-functional teams to align the platform with company goals.

Candidates should have strong experience with cloud platforms, microservices, and AI/LLM APIs, and a track record of delivering scalable systems for high user volumes.