Head of LLM Systems & AI Platform

hermeneutic research

Hong Kong

On-site

HKD 900,000 - 1,300,000

Full time

14 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

hermeneutic Research Labs in Hong Kong seeks a Lead AI Engineer to own and evolve a multi-agent research system. You will start hands-on, writing code and running experiments, then hire and lead engineers as the function grows toward Head of AI Engineering.

The role focuses on reliable LLM layers, cost-aware routing, and scientifically grounded evaluation. You will shape architecture, enable rigorous measurement, and partner with researchers and traders to turn data into disciplined, measurable

Qualifications

  • 7+ years of software or ML engineering experience with production ML systems.
  • 3+ years shipping LLM-backed systems with latency, cost and quality ownership.
  • 2+ years leading engineers while delivering production-ready work.
  • Strong Python, including async concurrency and tooling.
  • Experience with self-hosted serving (vLLM or similar) and GPU planning.
  • Expertise in vector and graph retrieval for ML pipelines.

Responsibilities

  • Keep the LLM layer reliable: latency budgets, concurrency, degradation modes and provider failover.
  • Build evaluation tied to research outcomes with labeled data and online experiments.
  • Control cost and routing across models, caching, batching, and self-hosted serving economics.
  • Run model strategy and lifecycle with versioning, rollback and provider diversification.
  • Shape the agent architecture with evidence, improving memory, retrieval and tool use.
  • Ground outputs with citations, audit trails, and clear model vs. suggestion boundaries.
  • Build and lead an AI engineering team as the function grows.

Skills

Python
Async concurrency
LLM systems
LLM deployment
Self-hosted serving
GPU capacity planning
Vector retrieval
Graph retrieval
Leadership experience
Cost management

Tools

vLLM

Job description

hermeneutic Research Labs in Hong Kong seeks a Lead AI Engineer to own and evolve a multi-agent research system. You will start hands-on, writing code and running experiments, then hire and lead engineers as the function grows toward Head of AI Engineering.

The role focuses on reliable LLM layers, cost-aware routing, and scientifically grounded evaluation. You will shape architecture, enable rigorous measurement, and partner with researchers and traders to turn data into disciplined, measurable

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal AI Solutions Engineer & Agentic LLM Architect
Principal AI Solutions Engineer & Agentic LLM Architect

Randstad Hong Kong • Hong Kong

On-site
HKD 1,200,000 - 1,800,000
Lead AI Platform Architect: Multi-Agent & LLM Orchestration
Lead AI Platform Architect: Multi-Agent & LLM Orchestration

Randstad Hong Kong Limited • Hong Kong

On-site
HKD 1,100,000 - 1,700,000
LLM Agent Architect & Autonomous Systems Lead
LLM Agent Architect & Autonomous Systems Lead

Spirit Elephant (International) Co., Limited • Hong Kong

On-site
HKD 450,000 - 800,000
Visa sponsorship
Competitive compensation
Performance bonus
AI Engineering Lead
AI Engineering Lead

TEKsystems Global Services, LLC • Hong Kong

On-site
HKD 1,200,000 - 2,600,000
Senior LLM Engineer: RAG & Agentic Workflows Architect
Senior LLM Engineer: RAG & Agentic Workflows Architect

Randstad Hong Kong Limited • Hong Kong

On-site
HKD 900,000 - 1,500,000
Agent Application Development - LLM Track
Agent Application Development - LLM Track

Spirit Elephant (International) Co., Limited • Hong Kong

On-site
HKD 450,000 - 800,000
Visa sponsorship
Competitive compensation
Performance bonus
Senior AI Engineer Lead — Enterprise LLM & RAG Architect
Senior AI Engineer Lead — Enterprise LLM & RAG Architect

ConnectedGroup • Hong Kong

Hybrid
HKD 900,000 - 1,300,000
Senior LLM Engineer / AI Engineer - RAG & Agentic Workflows
Senior LLM Engineer / AI Engineer - RAG & Agentic Workflows

Randstad Hong Kong Limited • Hong Kong

On-site
HKD 900,000 - 1,500,000
Lead AI Platform Engineer — MLOps/LLMOps (Hong Kong)
Lead AI Platform Engineer — MLOps/LLMOps (Hong Kong)

Recruit Squad Limited • Hong Kong

On-site
HKD 480,000 - 800,000
Agentic AI Engineer: LLM Systems & Orchestration
Agentic AI Engineer: LLM Systems & Orchestration

Pinpoint Asia • Hong Kong

Hybrid
HKD 700,000 - 1,200,000