Technical Test Services Evaluation Manager, AI Tester Accreditation Programme (AI TAP)

Government Technology Agency (GovTech); Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

AI Verify Foundation is seeking a skilled accreditation lead to manage end-to-end accreditation for AI testing service providers, evaluate technical capabilities, and engage with industry stakeholders to shape standards in AI safety and governance.

You will collaborate with government agencies, industry partners, and firms to refine assessment scopes, produce evaluation reports, and ensure the programme remains credible and up-to-date in a fast-evolving AI landscape.

Qualifications

• Academic background in a relevant technical field with strong analytic ability.
• Excellent written and verbal communication, able to present complex concepts clearly.
• Experience engaging with industry, government, and technical communities.

Responsibilities

• Lead the end-to-end accreditation process for AI testing service providers.
• Evaluate applicant firms against defined criteria and guidelines.
• Engage with industry stakeholders to refine assessment scope and standards.
• Develop accreditation documentation, rubrics, and evaluation reports.

Skills

Analytical skills

Communication skills

Stakeholder engagement

Self-motivation

Education

Bachelor's degree in Computer Science / AI / IT / Engineering

Job description

What the role is

About Us AI Verify Foundation is an open-source initiative and a wholly owned subsidiary under the Infocomm Media Development Authority (IMDA), dedicated to advancing trustworthy AI. We develop and maintain open-source tools for evaluating LLM applications (Project Moonshot) and predictive ML models (AI Verify Toolkit). Our mission is to empower developers, data scientists, and organisations to build responsible, transparent, and reliable AI systems.

The AI Verify Foundation's AI Tester Accreditation Programme (AI TAP) is the first programme of its kind in Asia, accrediting testing service firms that can technically assess AI systems for safety, reliability, and governance risks. Accredited firms are recognised by AI Verify Foundation as having possessed the technical competencies and operational readiness to evaluate AI systems against a defined scope to provide AI system developers, deployers, and end users with greater confidence in independently assessed AI.

You will be part of a dynamic team driving the growth of Singapore's AI assurance ecosystem. In this role, you will lead the end-to-end accreditation process for AI testing service providers, evaluate their technical and operational capabilities, and work closely with industry stakeholders to shape emerging standards for AI technical testing.

You will also engage with businesses seeking qualified AI assurance testers, connecting them with accredited firms and supporting the broader development of a trusted AI assurance marketplace. You will collaborate with local and international industry partners, government agencies, and internal teams to continuously refine the programme's assessment scope and standards, ensuring AI TAP remains credible, rigorous, and relevant in a rapidly evolving AI landscape.

What you will be working on

Lead and manage the full accreditation lifecycle for AI testing service providers, including application review, technical evaluation, accreditation decisions, and annual renewals. Evaluate applicant firms against defined accreditation criteria, covering technical testing competency. Assess firms' claimed AI testing services against established guidelines and frameworks (e.g., IMDA Starter Kit for Testing LLM-Based Applications for Safety and Reliability). Engage with industry stakeholders, testing service providers, and AI system developers and deployers to understand evolving needs and refine the programme's assessment scope and standards. Develop and maintain accreditation documentation, evaluation rubrics, and assessment guidelines to ensure consistency and rigour across all accreditation reviews. Monitor developments in AI testing methodologies, safety frameworks, and governance standards to ensure the programme remains current and credible.

What we are looking for

• (A) Academic Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, Engineering, or a related field. Professional certifications in AI governance (e.g., AIGP: Artificial Intelligence Governance Professional) or GenAI / Agentic AI testing are advantageous.
• (B) Experience Minimum of 3-5 years of experience in GenAI / Agentic AI systems evaluation, technical testing, software quality assurance, or a related field. Strong working knowledge of AI system development lifecycles, including Generative AI and LLM-based applications, and associated safety and reliability considerations. Demonstrated experience in designing or managing accreditation, certification, or audit programmes is highly desirable. Familiarity with AI governance frameworks, responsible AI principles, and technical testing standards (e.g., IMDA AI testing guidelines, ISO/IEC AI standards). Experience engaging with senior stakeholders across industry, government, and technical communities.
• (C) Other Key Areas of Consideration Strong analytical and evaluative skills, with the ability to assess complex technical claims and make well-reasoned accreditation judgements. Excellent interpersonal and communication skills, with the ability to engage effectively with both technical experts and non-technical stakeholders (including C-suite executives and policy makers). Self-motivated and adaptable, with the ability to operate effectively in a nascent and evolving programme environment where standards and processes are still being shaped. Commercially aware, with an understanding of the AI testing services market and the business considerations of testing service providers. Plugged into the AI, tech, and assurance ecosystem in Singapore, with a genuine interest in advancing the responsible development and deployment of AI. Strong written and verbal communication skills, including the ability to produce clear, well-structured evaluation reports and programme documentation.

Position will be commensurate with the candidate’s qualifications and experience.

Please note that only shortlisted candidates will be notified.

The Singapore Public Service plays a key role in the economic growth, progress and stability of Singapore by formulating and implementing government policies, as well as providing key public services. Whether you are a fresh graduate joining the workforce or an experienced professional, the Singapore Public Service offers a great variety of job opportunities for you. The work in the Public Service can be broadly categorised into the following sectors: Economic, Social, Security & External Relations, and Administration & Corporate Development. Be part of the team that shapes the future of Singapore.