Senior AI QA Engineer - Annotations & Data Validation

9752 Genpact (UK) Limited; City Of London; On-site; GBP 60,000 - 90,000; Full time

Job summary

Genpact is seeking a Sr. Engineer in Testing & Quality Assurance P to execute AI annotation and evaluation activities.

You will validate AI outputs against predefined questions, create and review annotations, and test Databricks Genie responses for accuracy and consistency. The role requires strong SQL skills, experience in QA for AI systems, and a strong educational background in computer engineering/science/IT with relevant certifications.

Qualifications

• Bachelor-level degrees in computer engineering, CS or IT with a Master’s in software engineering or equivalent.
• CSTE certification or equivalent quality assurance certification is preferred.
• Experience with AI/QA testing, data annotation, and SQL testing is expected.

Responsibilities

• Execute annotation, evaluation, and validation activities for AI-powered solutions using guidelines and quality standards.
• Validate AI outputs against golden questions and expected results.
• Create, maintain, and review annotations to support AI model evaluation and continuous improvement.
• Test Databricks Genie responses for accuracy, completeness, relevance, and consistency.
• Write and execute SQL queries to validate answers from golden questions and Databricks Genie outputs.
• Identify discrepancies and document findings; lead standardization of annotation processes and prompts across AI use cases.

Skills

Data Annotation

Databricks AI/BI Genie

SQL Query Writing Language

Education

Bachelor's degree in Computer Engineering

Bachelor's degree in Computer Science

Bachelor's degree in Information Technology

Master's in Software Engineering

Certified Software Tester (CSTE)

Job description

Genpact is seeking a Sr. Engineer in Testing & Quality Assurance P to execute AI annotation and evaluation activities.

You will validate AI outputs against predefined questions, create and review annotations, and test Databricks Genie responses for accuracy and consistency. The role requires strong SQL skills, experience in QA for AI systems, and a strong educational background in computer engineering/science/IT with relevant certifications.