Senior AI/ML Model Validation Lead

The Japan Research Institute, Limited (Singapore Branch); Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

The Japan Research Institute, Limited (Singapore Branch) is seeking an experienced AI/ML QA/Test Engineer to define and execute test strategies for statistical, ML, LLM, and agentic AI models in Singapore. You will perform functional, regression and scenario-based testing, evaluating accuracy, bias, robustness and drift while ensuring end‑to‑end workflow reliability.

You will design automated pipelines, validate API/tool integrations, and collaborate with data scientists and engineers to ensure

Qualifications

• Minimum 4 years of relevant experience in model testing, QA/QC, AI/ML evaluation, CI/CD, MLOps, data engineering, or related technical roles.
• Proficiency in Python and SQL with experience in ML tooling and data pipelines.

Responsibilities

• Define and execute comprehensive test strategies for statistical, ML, LLM and agentic AI models.
• Perform functional, regression and scenario-based testing of model behaviours and workflows.
• Conduct AI/ML evaluations including accuracy checks, bias/fairness assessment, robustness analysis and drift detection.
• Assess end-to-end model workflows including data inputs, feature transformations, task completion, tool-use accuracy and multi-step reasoning.
• Design and maintain automated test and evaluation pipelines, including benchmarking and regression frameworks.
• Validate API and tool-integration behaviour in production-like environments, identifying dependency or orchestration issues.
• Diagnose issues using observability, logging, tracing and debugging tooling, and document findings clearly.
• Collaborate with data scientists across departments to understand modelling intent, feature logic and expected behaviours.
• Perform data-management tasks to support AI/ML model testing, including maintaining metadata and datasets clarity.
• Contribute to AI/ML POI initiatives to strengthen evaluation methodologies and support innovation.
• Support analytics initiatives such as the Analytics Workbench and contribute to AI/ML/data analytics enablement.

Skills

Communication skills

Collaboration

Documentation

Problem solving

Teamwork

Responsible AI concepts

Tools

Python

PySpark

MLlib

pytest

SQL

R

Scala

Rust

Java

JavaScript

C++

CI/CD

MLOps

Data engineering

Job description

The Japan Research Institute, Limited (Singapore Branch) is seeking an experienced AI/ML QA/Test Engineer to define and execute test strategies for statistical, ML, LLM, and agentic AI models in Singapore. You will perform functional, regression and scenario-based testing, evaluating accuracy, bias, robustness and drift while ensuring end‑to‑end workflow reliability.

You will design automated pipelines, validate API/tool integrations, and collaborate with data scientists and engineers to ensure