Test Lead (AI Testing)

tescom (singapore) software systems testing pte ltd.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Tescom is seeking a Test Lead to drive AI/ML testing strategies across projects, mentoring a diverse team of test analysts, and ensuring robust validation of models and data pipelines.

You will design frameworks for model evaluation, bias checks, and data integrity while coordinating with developers and data scientists to deliver reliable AI-driven solutions.

Qualifications

• Bachelor’s degree in IT, CS, or related field.
• 8+ years in software testing and test management.
• Strong knowledge of Agile/Waterfall SDLC.
• 3+ years in senior test roles.
• 2+ years testing AI/ML systems and LLMs.
• Proficient in Python or TypeScript; Playwright experience.
• Familiar with data privacy and AI governance standards.

Responsibilities

• AI Strategy & Framework Design: Define test strategies for AI/ML systems including data validation, model performance, and post-deployment monitoring.
• Team Leadership: Mentor a team of Test Analysts onshore and offshore with automation and AI testing methodologies.
• Model Validation: Establish metrics for accuracy, drift, bias, fairness, and robustness.
• Quality Auditing: Audit data pipelines with Developers and Data Engineers for data integrity and compliance.
• Risk-Based Test Prioritization: Balance comprehensive validation with agile delivery to identify critical failures.
• Client Stakeholder Management: Translate AI testing metrics into business risk assessments and governance reports.

Skills

AI/ML domain knowledge

Team leadership

Test strategy design

Communication

Regulatory awareness

Risk-based testing

Stakeholder management

Education

Bachelor’s degree in IT/CS

ISTQB CTFL

AI certifications

Tools

Playwright

TypeScript

Python

CI/CD pipelines

Job description

Tescom is an ITconsulting firm providing a range of professional services in functionaltesting, automation testing, cybersecurity testing, performance testing,independent IT auditing, usability testing, resource augmentation, IT supportand training.

We are looking to hirea Test Lead to join us in our projects involving Artificial Intelligence(AI) and Machine Language (ML) systems.

Responsibilities

1. AI Strategy& Framework Design: Define the overall Test Strategies/Plans forAI/ML systems, including the validation of training data, model performance,and post-deployment monitoring frameworks.

2. TeamLeadership:Guide and mentor, a team of Test Analysts, onshore and offshore, fosteringexpertise in both traditional automation frameworks (e.g.,Playwright/TypeScript) and AI-specific testing methodologies.

3. ModelValidation:Establish metrics and test protocols for model accuracy, drift, bias, fairness,and robustness against adversarial inputs.

4. QualityAuditing:Work with Developers, Data Engineers and Data Scientists to audit and validatedata pipelines, ensuring data integrity, proper labeling, and compliance withregulatory standards.

5. Risk-BasedTest Prioritization: Apply risk-based testing principles tobalance comprehensive model validation with agile delivery timelines,identifying critical failure modes before production.

6. ClientStakeholder Management: Act as the primary technical liaison forclient stakeholders, translating complex, probabilistic AI testing metrics(such as confidence scores, data drift, and bias risks) into clear,business-focused risk assessments. Manage client expectations regarding theinherently non-deterministic nature of AI systems and provide transparentgovernance reports and audit-ready test evidence to build trust in modelreliability.

Qualifications& Experience

1. Education: Bachelor’sdegree in information technology, computer science, or a related field.

2. Testing Experience: At least 8+years of experience in software testing and test management of IT systems, witha strong foundation in core testing methodologies (ISTQB standards preferred).

3. SDLC Knowledge: Strongunderstanding of IT project management methodologies (e.g., Agile, Waterfall)and software development life cycles.

4. TestingLeadership:3+ years of leadership experience in a Senior Test Analyst or Test Lead role.

5. AI/ML DomainKnowledge:At least 2+ years of experience in testing AI systems, LLMs, or predictivemodels. Familiarity with various model evaluation concepts (e.g.,precision/recall, F1 score, confusion matrices, data drift).

6. TechnicalProficiency: Strong programming skills in Python or TypeScript, andhands-on experience with automated testing tools like Playwright and CI/CDpipelines.

7. Regulatory& Compliance Awareness: Understanding of AI regulatory and governance frameworks (such as Singapore AI Verify, EU AI Act), data privacy regulations (such as GDPR, Singapore PDPA), and emerging AI governance standards.

8. Communication: Exceptional ability to bridge the gap between data science teams, software developers, and business stakeholders.

9. Technical Certifications: Candidates with ISTQB Certified Tester Foundation Level(CTFL) and AI-related certifications, would have an advantage.