Senior AI Testing & Assurance Lead

PRUDENTIAL SERVICES SINGAPORE PTE. LTD.; Singapore; On-site; SGD 250,000 - 380,000; Full time

Job summary

PRUDENTIAL SERVICES SINGAPORE PTE. LTD. invites a senior AI Testing & Assurance leader to design and execute testing for AI and ML solutions, including GenAI and agentic workflows, in Databricks, GCP Vertex AI, and enterprise environments.

The role blends hands-on evaluation with strategic stakeholder discussions, ensuring risk-managed, trusted outcomes across production AI. You will build reusable evaluation frameworks, integrate tests into CI/CD, monitor model drift, and oversee third-party

Qualifications

• Strong hands-on experience in AI testing, AI assurance, model validation, machine learning evaluation or responsible AI assessment.
• Solid understanding of AI and machine learning evaluation methods, including performance testing, robustness testing, fairness testing, explainability and model reliability.
• Experience testing AI or machine learning solutions in production or near-production environments.
• Experience designing and executing test frameworks for Traditional AI, Generative AI and / or Agentic AI systems.
• Strong technical understanding of MLOps, AI Ops, model lifecycle management, CI/CD and production AI deployment.
• Experience with platforms such as Databricks, Azure Databricks, Google Cloud / Vertex AI, MLflow or similar AI / ML platforms.
• Ability to develop reusable test libraries, evaluation tools, validation datasets and automated testing checkpoints.
• Experience with API testing, data pipelines, model monitoring and post-deployment validation.
• Strong communication skills, with the ability to explain technical testing results clearly to business, technology and risk stakeholders.

Responsibilities

• Design and execute testing strategies for AI systems, including traditional ML models, GenAI applications and Agentic AI workflows.
• Develop practical test plans, test cases, test datasets and evaluation approaches to assess AI model performance, reliability, safety and business suitability.
• Conduct hands-on AI model testing, including accuracy testing, robustness testing, bias and fairness testing, explainability review, edge-case testing and reliability assessment.
• Perform technical evaluations of internally developed AI use cases as well as vendor-provided and off-the-shelf AI solutions.
• Build and execute AI assurance checks to ensure AI systems are fit for deployment and continue to perform appropriately in production environments.
• Assess AI solutions against key dimensions such as performance, stability, fairness, explainability, security, scalability and operational resilience.

Skills

AI testing

AI assurance

Model validation

MLOps / AI Ops

Production AI environments

LLM evaluation

GenAI testing

Agentic AI testing

CI/CD pipelines

Adversarial testing

Tools

Databricks

Azure Databricks

Vertex AI

MLflow

Job description

PRUDENTIAL SERVICES SINGAPORE PTE. LTD. invites a senior AI Testing & Assurance leader to design and execute testing for AI and ML solutions, including GenAI and agentic workflows, in Databricks, GCP Vertex AI, and enterprise environments.

The role blends hands-on evaluation with strategic stakeholder discussions, ensuring risk-managed, trusted outcomes across production AI. You will build reusable evaluation frameworks, integrate tests into CI/CD, monitor model drift, and oversee third-party