Technical Test Services Evaluation Manager, AI Tester Accreditation Programme (AI TAP)

Public Service Division

Singapore

Presencial

SGD 110.000 - 150.000

Tempo integral

14 dias+

Uma candidatura completa em um minuto

Currículo e carta de apresentação personalizados, prontos para serem enviados.

Passe pelos filtros ATS

Resumo da vaga

AI Verify Foundation is seeking a seasoned professional to lead the end-to-end accreditation of AI testing service providers in Singapore. You will assess technical capabilities, engage with industry and government partners, and shape testing standards for responsible AI.

The role requires 3–5 years in GenAI/Agentic AI evaluation, strong analytical skills, and experience in accreditation programs. Singapore-based with a focus on credible, rigorous assessments.

Qualificações

  • Bachelor's degree in Computer Science, AI, IT, Engineering, or related field.
  • Certifications in AI governance (e.g., AIGP) or GenAI testing are advantageous.
  • 3–5 years of experience in GenAI/Agentic AI systems evaluation, testing, or QA.
  • Knowledge of AI lifecycle incl. Generative AI and LLM apps, safety and reliability.
  • Experience designing or managing accreditation/certification/audit programmes.
  • Familiarity with AI governance frameworks and testing standards (IMDA, ISO/IEC).
  • Experience engaging with senior stakeholders across industry, government, and tech communities.
  • Strong analytical, communication, and stakeholder skills; commercially aware and proactive.

Responsabilidades

  • Lead accreditation lifecycle for AI testing providers.
  • Evaluate applicants against accreditation criteria.
  • Develop evaluation rubrics and guidelines to ensure consistency.
  • Engage with industry and government to refine standards.
  • Produce clear evaluation reports and program documentation.
  • Monitor AI testing methodologies and governance developments.

Conhecimentos

GenAI understanding
AI governance
Stakeholder engagement

Formação

Bachelor's degree in CS/AI/IT/Engineering

Ferramentas

AI testing frameworks

Descrição da vaga

What the role is

About Us
AI Verify Foundation is an open source initiative and a wholly owned subsidiary under the Infocomm Media Development Authority (IMDA), dedicated to advancing trustworthy AI. We develop and maintain open source tools for evaluating LLM applications (Project Moonshot) and predictive ML models (AI Verify Toolkit). Our mission is to empower developers, data scientists, and organisations to build responsible, transparent, and reliable AI systems.

The AI Verify Foundation's AI Tester Accreditation Programme (AI TAP) is the first programme of its kind in Asia, accrediting testing service firms that can technically assess AI systems for safety, reliability, and governance risks. Accredited firms are recognised by AI Verify Foundation as having possessed the technical competencies and operational readiness to evaluate AI systems against a defined scope to provide AI system developers, deployers, and end users with greater confidence in independently assessed AI.

You will be part of a dynamic team driving the growth of Singapore's AI assurance ecosystem. In this role, you will lead the end-to-end accreditation process for AI testing service providers, evaluate their technical and operational capabilities, and work closely with industry stakeholders to shape emerging standards for AI technical testing. You will also engage with businesses seeking qualified AI assurance testers, connecting them with accredited firms and supporting the broader development of a trusted AI assurance marketplace.

You will collaborate with local and international industry partners, government agencies, and internal teams to continuously refine the programme's assessment scope and standards, ensuring AI TAP remains credible, rigorous, and relevant in a rapidly evolving AI landscape.

What you will be working on
  • Lead and manage the full accreditation lifecycle for AI testing service providers, including application review, technical evaluation, accreditation decisions, and annual renewals.
  • Evaluate applicant firms against defined accreditation criteria, covering technical testing competency.
  • Assess firms’ claimed AI testing services against established guidelines and frameworks (e.g., IMDA Starter Kit for Testing LLM-Based Applications for Safety and Reliability).
  • Engage with industry stakeholders, testing service providers, and AI system developers and deployers to understand evolving needs and refine the programme's assessment scope and standards.
  • Develop and maintain accreditation documentation, evaluation rubrics, and assessment guidelines to ensure consistency and rigour across all accreditation reviews.
  • Monitor developments in AI testing methodologies, safety frameworks, and governance standards to ensure the programme remains current and credible.
What we are looking for
(A) Academic
  • Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, Engineering, or a related field.
  • Professional certifications in AI governance (e.g., AIGP: Artificial Intelligence Governance Professional) or GenAI / Agentic AI testing are advantageous.
(B) Experience
  • Minimum of 3-5 years of experience in GenAI / Agentic AI systems evaluation, technical testing, software quality assurance, or a related field.
  • Strong working knowledge of AI system development lifecycles, including Generative AI and LLM-based applications, and associated safety and reliability considerations.
  • Demonstrated experience in designing or managing accreditation, certification, or audit programmes is highly desirable.
  • Familiarity with AI governance frameworks, responsible AI principles, and technical testing standards (e.g., IMDA AI testing guidelines, ISO/IEC AI standards).
  • Experience engaging with senior stakeholders across industry, government, and technical communities.
(C) Other Key Areas of Consideration
  • Strong analytical and evaluative skills, with the ability to assess complex technical claims and make well-reasoned accreditation judgements.
  • Excellent interpersonal and communication skills, with the ability to engage effectively with both technical experts and non-technical stakeholders (including C-suite executives and policy makers).
  • Self-motivated and adaptable, with the ability to operate effectively in a nascent and evolving programme environment where standards and processes are still being shaped.
  • Commercially aware, with an understanding of the AI testing services market and the business considerations of testing service providers.
  • Plugged into the AI, tech, and assurance ecosystem in Singapore, with a genuine interest in advancing the responsible development and deployment of AI.
  • Strong written and verbal communication skills, including the ability to produce clear, well-structured evaluation reports and programme documentation.

Position will be commensurate with the candidate’s qualifications and experience.

Please note that only shortlisted candidates will be notified.

Obtenha sua revisão de currículo grátis e confidencial.

ou arraste e solte seu arquivo aqui.

Similar jobs

Vagas similares que valem a pena comparar

Technical Test Services Evaluation Manager, AI Tester Accreditation Programme (AI TAP)
Technical Test Services Evaluation Manager, AI Tester Accreditation Programme (AI TAP)

IMDA • Singapore

Presencial
SGD 90.000 - 150.000
Lead AI Testing Accreditation
Lead AI Testing Accreditation

IMDA • Singapore

Presencial
SGD 90.000 - 150.000
AI Assurance Accreditation Manager
AI Assurance Accreditation Manager

Public Service Division • Singapore

Presencial
SGD 110.000 - 150.000
AI Safety & Governance Engineer (SAGE)
AI Safety & Governance Engineer (SAGE)

Nanyang Technological University • Singapore

Presencial
SGD 90.000 - 150.000
Manager, Tech Evaluation and Tech Acceleration Lab
Manager, Tech Evaluation and Tech Acceleration Lab

IMD Info-communications Media Development Authority • Singapore

Presencial
SGD 120.000 - 180.000
Senior Manager, Artificial Intelligence
Senior Manager, Artificial Intelligence

IMD Info-communications Media Development Authority • Singapore

Presencial
SGD 120.000 - 180.000
Head of AI Security and Assurance
Head of AI Security and Assurance

CHAPTR CONSULTING PTE. LTD. • Singapore

Presencial
SGD 180.000 - 300.000
Senior Manager, Artificial Intelligence
Senior Manager, Artificial Intelligence

GVT Government Technology Agency • Singapore

Presencial
SGD 180.000 - 260.000
AI Specialist
AI Specialist

Fugro • Singapore

Presencial
SGD 120.000 - 160.000
[LTA-TRO] SENIOR/ EXECUTIVE/ AI SOFTWARE DEVELOPER - TRANSPORT AI PROGRAMME
[LTA-TRO] SENIOR/ EXECUTIVE/ AI SOFTWARE DEVELOPER - TRANSPORT AI PROGRAMME

Land Transport Authority (LTA) Singapore • Singapore

Presencial
SGD 120.000 - 180.000