Lead AI Platform Architect - Multi-Agent Systems & LLM (HK)

Randstad Hong Kong

Hong Kong

On-site

HKD 1,100,000 - 1,700,000

Full time

4 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Randstad Hong Kong Limited is seeking a Lead/Principal AI Platform Architect in Hong Kong to spearhead an internal AI Center of Excellence. Architect autonomous SDLC, multi-agent orchestration, and a scalable LLM gateway across a global engineering org.

You will drive AIOps, security, and cost-governance while mentoring engineers to become prompt architects and multi-agent leaders in a fast-growing SaaS environment.

Qualifications

  • Minimum 7+ years of experience in platform architecture, distributed systems, SRE, or enterprise cloud infra.
  • Proven fluency with generative AI, agentic frameworks, prompt engineering patterns, and model-routing infra.
  • Strong cloud-native mastery across containerised environments and CI/CD automation.
  • Deep integration experience across REST/gRPC, message brokers, and observability stacks.
  • Leadership to drive PoCs, internal platforms, and behavioural shifts.
  • Bachelor's or Master's in CS/Software Eng or equivalent practical systems experience.
  • Fluency in English and Cantonese; Mandarin a plus.

Responsibilities

  • Architect an autonomous SDLC by integrating intelligence into scoping, synthetic testing, PR generation, and deployment verification.
  • Design and deploy enterprise-grade, sandboxed multi-agent orchestration frameworks across code repos, issue trackers, and CI/CD pipelines.
  • Develop an enterprise LLM gateway with dynamic model-routing and parallel inference layers for benchmarking throughput/latency/accuracy.
  • Establish robust cost-governance across token budgets, compute usage, and attribution metrics.
  • Implement AIOps and self-healing remediation workflows to monitor telemetry and minimise MTTR.
  • Enforce strict security boundaries, hermetic sandboxing, and deterministic permission controls.
  • Guide engineers to evolve into prompt architects and multi-agent systems directors.

Skills

Platform architecture
Distributed systems
SRE
Generative AI
LangChain
LlamaIndex
AutoGen
CrewAI
Kubernetes
REST/gRPC APIs
CI/CD automation
English & Cantonese

Education

Bachelor Degree in CS/Software Engineering

Tools

Kubernetes

Job description

A high-growth enterprise SaaS leader is seeking a Lead / Principal AI Platform Architect in Hong Kong to spearhead their internal AI Center of Excellence. Architect autonomous multi-agent developer workflows, scalable LLM orchestration, and self-healing cloud infrastructure across a global engineering organisation. Accelerate enterprise-scale DevOps innovation using bleeding-edge generative AI technologies.

about the company.

Our client is a high-growth, venture-backed enterprise SaaS organisation scaling rapidly across APAC and global markets. Committed to continuous engineering excellence, they are investing heavily in cutting-edge infrastructure and automated developer ecosystems. The organisation fousst fosters an innovative, high-trust engineering culture focused on technical autonomy, modern cloud-native practices, and sustainable technological scaling.

about the team.

You will join a newly established Internal AI Center of Excellence composed of top-tier systems engineers, distributed platform specialists, and machine learning architects. Rather than building external chatbots, this strategic unit pioneers internal transformation, directly empowering tech squads across the firm to adopt agentic workflows, intelligent automation, and advanced generative AI tooling.

about the job.
  • Architect an autonomous Software Development Life Cycle (SDLC) by integrating intelligence into scoping, synthetic testing, pull request generation, and deployment verification.

  • Design and deploy enterprise-grade, sandboxed multi-agent orchestration frameworks where autonomous agents securely interface with code repositories, issue trackers, and CI/CD pipelines.

  • Develop an enterprise LLM gateway with dynamic model-routing and parallel inference layers to benchmark throughput, latency, and accuracy across frontier and open-weight models.

  • Establish robust cost-governance frameworks, tracking token budgets, compute utilisation, and attribution metrics across squads.

  • Implement AIOps and closed-loop, self-healing remediation workflows to monitor telemetry, triage system alerts, and minimise Mean Time to Resolution (MTTR).

  • Implement strict security boundaries, hermetic sandboxing, and deterministic permission controls to safeguard proprietary source code and runtime secrets.

  • Champion technical enablement and cultural change, guiding software engineers as they evolve into prompt architects and multi-agent systems directors.

skills & experience required.
  • Minimum 7+ years of experience in platform architecture, distributed systems, site reliability engineering (SRE), or enterprise cloud infrastructure.

  • Proven architectural fluency with generative AI, agentic frameworks (e.g., LangChain, LlamaIndex, AutoGen, CrewAI), prompt engineering patterns, and model-routing infrastructure.

  • Strong cloud-native mastery across containerised environments, including Kubernetes, container sandboxing, microservices concurrency, and modern CI/CD automation.

  • Deep integration expertise connecting heterogeneous developer ecosystems via REST/gRPC APIs, message brokers, and enterprise observability stacks.

  • Demonstrated leadership ability to lead technical proof-of-concepts, deliver robust internal platforms, and influence behavioural engineering shifts.

  • Bachelor's or Master's degree in Computer Science, Software Engineering, or equivalent practical systems engineering experience.

  • Fluency in written and spoken English and Cantonese is required; professional working proficiency in Mandarin is an advantage.

  • Candidates with proven depth in enterprise systems leadership will be considered for the Senior or Principal title.

skills

no additional skills required

qualifications

no additional qualifications required

education

Bachelor Degree

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AI Platform Architect: Multi-Agent & LLM Orchestration
Lead AI Platform Architect: Multi-Agent & LLM Orchestration

Randstad Hong Kong Limited • Hong Kong

On-site
HKD 1,100,000 - 1,700,000
AI Engineering Lead
AI Engineering Lead

TEKsystems Global Services, LLC • Hong Kong

On-site
HKD 1,200,000 - 2,600,000
AI Developer - Generative AI & Automation (Hong Kong)
AI Developer - Generative AI & Automation (Hong Kong)

Randstad Hong Kong Limited • Hong Kong

On-site
HKD 420,000 - 660,000
Senior LLM Engineer / AI Engineer - RAG & Agentic Workflows
Senior LLM Engineer / AI Engineer - RAG & Agentic Workflows

Randstad Hong Kong Limited • Hong Kong

On-site
HKD 900,000 - 1,500,000
Machine Learning Engineering Manager - MLOps & GenAI
Machine Learning Engineering Manager - MLOps & GenAI

Randstad Hong Kong Limited • Hong Kong

On-site
HKD 1,100,000 - 1,500,000
Solution Architect (Data & AI)
Solution Architect (Data & AI)

Randstad Hong Kong Limited • Hong Kong

Hybrid
HKD 900,000 - 1,400,000
Head of Data / AI
Head of Data / AI

Quam Plus International Financial Limited • Hong Kong

On-site
HKD 2,000,000 - 4,000,000
AI Engineering Lead (GenAI / Platform)
AI Engineering Lead (GenAI / Platform)

Michael Page (Hong Kong) • Hong Kong

On-site
HKD 900,000 - 1,200,000
Machine Learning Engineer - MLOps & Generative AI (Hong Kong)
Machine Learning Engineer - MLOps & Generative AI (Hong Kong)

Randstad Hong Kong • Hong Kong

On-site
HKD 600,000 - 1,200,000
AI Engineering Manager/ Senior Manager - LLMs, RAG, agentic workflows
AI Engineering Manager/ Senior Manager - LLMs, RAG, agentic workflows

WilliamSELECT • Hong Kong

On-site
HKD 700,000 - 900,000