Senior AI QA Engineer – Annotation & Governance

1401 Genpact India Pvt. Ltd.; Greater London; On-site; GBP 60,000 - 90,000; Full time

Job summary

Genpact is seeking a Sr. Engineer - Testing & Quality Assurance to lead testing and QA efforts for AI-related projects in the United Kingdom.

The role focuses on designing and standardizing annotation processes, governing schemas, and evaluating high-risk AI outputs to ensure auditability and quality. You will collaborate with data scientists, content reviewers, and product teams to implement scalable QA practices, drive continuous improvement, and mentor junior annotators.

Qualifications

• Bachelor degrees in Computer Engineering, Computer Science or Information Technology; Master in Software Engineering.
• Certified Software Tester (CSTE) - Tricentis is required or desirable.
• Strong experience with Agile methodologies and QA automation tools.

Responsibilities

• Identify and manage project deliverables.
• Lead the design, optimization, and standardization of annotation process and prompts across multiple AI use cases.
• Collaborate with the AI team to define and govern annotation schemas, taxonomies, and evaluation rubrics.
• Review complex or high-risk AI outputs and provide authoritative quality judgments.
• Ensure consistency, accuracy, and auditability of annotation and evaluation results.
• Define reusable prompt frameworks and best practices aligned with business and compliance objectives.
• Evaluate prompt performance at scale and guide improvements based on data-driven insights.
• Establish quality benchmarks, calibration processes, and escalation protocols.
• Identify bias, hallucinations, and systemic risks in AI outputs and recommend mitigation strategies.
• Support AI governance, compliance, and responsible AI initiatives.
• Participate in calibration sessions to align on annotation standards and evaluation criteria.
• Contribute to calibration sessions and help align annotation quality across the team.
• Work closely with AI team data scientists, content reviewers, and product teams.
• Drive process and delivery improvement by learning new delivery methodologies, AI modelling and approach to data annotation, through continuous learning and personal development.
• Mentor and coach junior and intermediate annotators / prompt engineers.

Skills

Agile Methodology

Appium

Automated Testing

QA Automation

Selenium

Cypress.io Testing Framework

TOSCA Testsuite

Design Thinking

Executive Presence

Personal Effectiveness

Quality Assurance (QA)

Quality Management

QA Consulting

Test Process Improvement (TPI)

Cucumber (Software)

Education

Bachelor's in Computer Engineering

Bachelor's in Computer Science

Bachelor's in Information Technology

Master's in Software Engineering

Tools

iTKO LISA

Cucumber

Selenium

Cypress.io Testing Framework

Appium

Selenium

TOSCA Testsuite

Job description

Genpact is seeking a Sr. Engineer - Testing & Quality Assurance to lead testing and QA efforts for AI-related projects in the United Kingdom.

The role focuses on designing and standardizing annotation processes, governing schemas, and evaluating high-risk AI outputs to ensure auditability and quality. You will collaborate with data scientists, content reviewers, and product teams to implement scalable QA practices, drive continuous improvement, and mentor junior annotators.