Regional AI Quality & Evaluation Engineer – Asia

Argyll Scott

Hong Kong

On-site

HKD 900,000 - 1,200,000

Full time

11 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Argyll Scott is partnering with a global life insurer to establish a Regional AI Centre of Excellence in Hong Kong. The AI Quality and Evaluation Engineer will help define success metrics and gather evidence for release decisions, collaborating across engineering, data science and business teams to assess AI performance in real business tasks.

The role emphasizes evaluating grounding, robustness, safety, and tool-use, with a focus on translating business needs into concrete tests.

Qualifications

  • Strong coding and automated testing experience.
  • Experience designing experiments with measurable criteria.
  • Knowledge of ML, generative AI or agentic-system evaluation.
  • Ability to translate business expectations into practical tests and communicate results clearly.

Responsibilities

  • Create representative evaluation datasets and test sets.
  • Define measurable business-task performance criteria with domain experts.
  • Build automated regression suites for ML, generative AI and agentic systems.
  • Evaluate grounding, robustness, safety, and tool-use behavior.
  • Produce reproducible evidence for release decisions.
  • Establish continuous production evaluation to identify degradation and risks.

Skills

Coding & test automation
Experiment design
ML/GenAI evaluation
Test result communication

Job description

Argyll Scott is partnering with a global life insurer to establish a Regional AI Centre of Excellence in Hong Kong. The AI Quality and Evaluation Engineer will help define success metrics and gather evidence for release decisions, collaborating across engineering, data science and business teams to assess AI performance in real business tasks.

The role emphasizes evaluating grounding, robustness, safety, and tool-use, with a focus on translating business needs into concrete tests.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Quality & Evaluation Engineer – Production Safety
LLM Quality & Evaluation Engineer – Production Safety

Argyll Scott • Hong Kong

On-site
HKD 500,000 - 900,000
Asia AI Insurance Business Analyst — Regional Centre
Asia AI Insurance Business Analyst — Regional Centre

Argyll Scott • Hong Kong

On-site
HKD 900,000 - 1,300,000
Asia AI Portfolio Lead – Insurance Transformation
Asia AI Portfolio Lead – Insurance Transformation

Argyll Scott • Hong Kong

On-site
HKD 1,200,000 - 1,800,000
Regional Data Scientist – AI & GenAI for Insurance (Hong Kong)
Regional Data Scientist – AI & GenAI for Insurance (Hong Kong)

Argyll Scott • Hong Kong

On-site
HKD 600,000 - 900,000
Data Scientist, Asia – Regional AI Centre of Excellence
Data Scientist, Asia – Regional AI Centre of Excellence

Argyll Scott • Hong Kong

Remote
HKD 600,000 - 1,200,000
Regional AI Transformation Analyst
Regional AI Transformation Analyst

Argyll Scott • Hong Kong

On-site
HKD 900,000 - 1,300,000
Global Life Insurer - Asia AI Quality Evaluation Engineer
Global Life Insurer - Asia AI Quality Evaluation Engineer

Argyll Scott • Hong Kong

On-site
HKD 500,000 - 900,000
AI-Ready Data Engineer - Asia Regional Platform
AI-Ready Data Engineer - Asia Regional Platform

Argyll Scott • Hong Kong

On-site
HKD 900,000 - 1,300,000
Global Life Insurer - Asia AI Quality & Evaluation Engineer (Regional)
Global Life Insurer - Asia AI Quality & Evaluation Engineer (Regional)

Argyll Scott • Hong Kong

On-site
HKD 900,000 - 1,300,000
Global Life Insurer - Asia AI Qual & Eval Engineer (Regional)
Global Life Insurer - Asia AI Qual & Eval Engineer (Regional)

Argyll Scott • Hong Kong

On-site
HKD 900,000 - 1,200,000