Global Life Insurer - Asia AI Qual & Eval Engineer (Regional)

Argyll Scott

Hong Kong

On-site

HKD 900,000 - 1,200,000

Full time

8 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Argyll Scott is partnering with a global life insurer to establish a Regional AI Centre of Excellence in Hong Kong. The AI Quality and Evaluation Engineer will help define success metrics and gather evidence for release decisions, collaborating across engineering, data science and business teams to assess AI performance in real business tasks.

The role emphasizes evaluating grounding, robustness, safety, and tool-use, with a focus on translating business needs into concrete tests.

Qualifications

  • Strong coding and automated testing experience.
  • Experience designing experiments with measurable criteria.
  • Knowledge of ML, generative AI or agentic-system evaluation.
  • Ability to translate business expectations into practical tests and communicate results clearly.

Responsibilities

  • Create representative evaluation datasets and test sets.
  • Define measurable business-task performance criteria with domain experts.
  • Build automated regression suites for ML, generative AI and agentic systems.
  • Evaluate grounding, robustness, safety, and tool-use behavior.
  • Produce reproducible evidence for release decisions.
  • Establish continuous production evaluation to identify degradation and risks.

Skills

Coding & test automation
Experiment design
ML/GenAI evaluation
Test result communication

Job description

Regional AI Centre of Excellence | Global Life Insurer
Location: Hong Kong; candidates based in the Philippines or India may also be considered
Experience: 2-10+ years, depending on relevant agentic AI, ML or application experience
The opportunity

We are partnered with a global life insurer to build out its regional AI Centre of Excellence, supporting AI-led transformation across its Asian businesses. As machine learning, generative AI and agentic solutions become part of business workflows, robust evaluation will be central to their successful adoption.

As an AI Quality and Evaluation Engineer, you will help define what good performance looks like and build the evidence that supports confident release decisions. Working across engineering, data science and business teams, you will assess both technical behaviour and the ability of AI solutions to perform meaningful business tasks.

What you will do
  • Create representative evaluation datasets and reference test sets.
  • Define measurable business-task performance criteria with domain specialists.
  • Build automated regression suites for ML, generative AI and agentic systems.
  • Evaluate grounding, robustness, safety and tool-use behaviour.
  • Produce clear, reproducible evidence for release and delivery stage-gate decisions.
  • Establish continuous production evaluation to identify degradation and emerging risks.
What you will bring
  • Strong coding and test automation skills.
  • Experience designing experiments and measurable evaluation criteria.
  • Knowledge of ML, generative AI or agentic-system evaluation.
  • Ability to translate business expectations into practical tests and communicate results clearly.
Preferred: English and Chinese language capability, and insurance-industry experience.
Why this role

You will help shape evaluation practices for emerging AI technologies across a regional portfolio, with direct influence on how solutions are tested, released and monitored in production.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Global Life Insurer - Asia AI Quality Evaluation Engineer
Global Life Insurer - Asia AI Quality Evaluation Engineer

Argyll Scott • Hong Kong

On-site
HKD 500,000 - 900,000
Global Life Insurer - Asia AI Quality & Evaluation Engineer (Regional)
Global Life Insurer - Asia AI Quality & Evaluation Engineer (Regional)

Argyll Scott • Hong Kong

On-site
HKD 900,000 - 1,300,000
Global Life Insurer - Asia Data Scientist (ML / GenAI)
Global Life Insurer - Asia Data Scientist (ML / GenAI)

Argyll Scott • Hong Kong

On-site
HKD 600,000 - 900,000
Asia AI Business Analyst / Solutions Consultant (Insurance)
Asia AI Business Analyst / Solutions Consultant (Insurance)

Argyll Scott • Hong Kong

On-site
HKD 600,000 - 900,000
Global Life Insurer - Asia Data Scientist (ML/ GenAI)
Global Life Insurer - Asia Data Scientist (ML/ GenAI)

Argyll Scott • Hong Kong

Remote
HKD 600,000 - 1,200,000
Global Life Insurer - Asia Senior Data Scientist (ML / Agentic)
Global Life Insurer - Asia Senior Data Scientist (ML / Agentic)

Argyll Scott • Hong Kong

On-site
HKD 900,000 - 1,200,000
Global Life Insurer - Asia (MLOps / LLMOps) Engineer Regional
Global Life Insurer - Asia (MLOps / LLMOps) Engineer Regional

Argyll Scott • Hong Kong

Hybrid
HKD 900,000 - 1,500,000
Global Life Insurer - Asia AI Portfolio Manager (Regional)
Global Life Insurer - Asia AI Portfolio Manager (Regional)

Argyll Scott • Hong Kong

On-site
HKD 1,200,000 - 1,800,000
Regional AI Business Analyst / Solutions Consultant (Insurance)
Regional AI Business Analyst / Solutions Consultant (Insurance)

Argyll Scott • Hong Kong

On-site
HKD 900,000 - 1,200,000
Global Life Insurer - Asia Agentic AI Engineer (Regional)
Global Life Insurer - Asia Agentic AI Engineer (Regional)

Argyll Scott • Hong Kong

Hybrid
HKD 1,000,000 - 1,300,000