Senior AI QA & Annotation Engineer

3502 Servicios Internacionales De Atencion Al Cliente, Limitada; England; On-site; GBP 60,000 - 80,000; Full time

Job summary

Genpact is seeking a Sr. Engineer for Testing & Quality Assurance P to join our AI-focused team in the United Kingdom.

You will execute annotation, evaluation, and validation activities for AI-powered solutions, validate outputs against golden questions, and lead standardization of annotation workflows across multiple AI use cases. The role requires a strong background in data annotation, SQL, and Databricks Genie, plus advanced English proficiency.

Qualifications

• Bachelor's degree in Computer Engineering, Computer Science, Information Technology or similar.
• Certified Software Tester (CSTE) - Tricentis is preferred.
• Advanced English (C1) required.

Responsibilities

• Execute annotation, evaluation, and validation activities for AI-powered solutions using established guidelines and quality standards.
• Validate AI-generated outputs against a predefined set of golden questions and expected results.
• Create, maintain, and review annotations to support AI model evaluation and continuous improvement.
• Test and evaluate Databricks Genie responses for accuracy, completeness, relevance, and consistency.
• Write and execute SQL queries against underlying data sources to validate answers generated from golden questions and Databricks Genie outputs.
• Investigate discrepancies between expected results, source data, and AI-generated responses, and document findings.
• Lead the design, optimization, and standardization of annotation processes and prompts across multiple AI use cases.
• Collaborate with AI teams to define and govern annotation schemas, taxonomies, evaluation frameworks, and quality standards.
• Review complex or high-risk AI outputs and provide expert quality assessments and recommendations.
• Ensure consistency, accuracy, traceability, and auditability of annotation and evaluation results.
• Define reusable prompt frameworks and best practices aligned with business, compliance, and responsible AI objectives.

Skills

Data Annotation

Databricks AI/BI Genie

SQL Query Writing

Education

Bachelor's - Computer Engineering

Bachelor's - Computer Science

Bachelor's - Information Technology

Master's - Software Engineering

Tools

CSTE - Tricentis

Job description

Genpact is seeking a Sr. Engineer for Testing & Quality Assurance P to join our AI-focused team in the United Kingdom.

You will execute annotation, evaluation, and validation activities for AI-powered solutions, validate outputs against golden questions, and lead standardization of annotation workflows across multiple AI use cases. The role requires a strong background in data annotation, SQL, and Databricks Genie, plus advanced English proficiency.