AI Quality Assurance Lead: Annotation & Validation

9752 Genpact (UK) Limited; City Of London; On-site; GBP 90,000 - 120,000; Full time

Job summary

Genpact is seeking a Tech Lead in Testing & Quality Assurance to drive annotation quality and evaluation for AI-powered solutions. You will lead design, validation, and optimization of annotation processes, collaborate with AI teams, and mentor junior annotators in a fast-moving AI-driven environment.

The role emphasizes governance, bias mitigation, and rigorous quality standards while coordinating with data scientists, engineers, and product teams.

Qualifications

• Bachelor-level and master-level software quality assurance qualifications.
• Experience with AI/ML annotation and evaluation workflows.
• Proven ability to design and standardize annotation processes and prompts.

Responsibilities

• Execute annotation, evaluation, and validation activities for AI-powered solutions using established guidelines and quality standards.
• Validate AI-generated outputs against golden questions and expected results.
• Create, maintain, and review annotations to support model evaluation and continuous improvement.
• Test and evaluate Databricks Genie responses for accuracy, completeness, relevance, and consistency.
• Write and execute SQL queries against data sources to validate AI-generated answers.

Skills

Data Annotation

Databricks Genie

SQL Query Writing

English Proficiency (C1)

Education

Bachelor's - Computer Engineering

Bachelor's - Computer Science

Bachelor's - Information Technology

Masters - Software Engineering

CSQA - Romtraining

CSTE - Tricentis

Hexawise Test Professional Certification

ISTQB Certified Tester

Selenium Basics - Great Learning

Tools

Databricks Genie

SQL Tools

Job description

Genpact is seeking a Tech Lead in Testing & Quality Assurance to drive annotation quality and evaluation for AI-powered solutions. You will lead design, validation, and optimization of annotation processes, collaborate with AI teams, and mentor junior annotators in a fast-moving AI-driven environment.

The role emphasizes governance, bias mitigation, and rigorous quality standards while coordinating with data scientists, engineers, and product teams.