Sr. Engineer - Testing & Quality Assurance P 4B

BrightClaim; Greater London; On-site; GBP 70,000 - 110,000; Full time

Job summary

Genpact in London is seeking a Sr. Engineer for Testing and Quality Assurance to lead AI annotation, evaluation, and validation activities. You will ensure outputs meet quality standards and align with predefined golden questions and matrices.

You will collaborate with AI teams to define evaluation frameworks, maintain annotation schemas, and drive improvements across multiple AI use cases. The role involves SQL-based validation and quality governance in a fast-moving innovation environment.

Qualifications

• Experience in AI annotation, evaluation and QA testing.
• Ability to design and apply evaluation guidelines and QA standards.
• Strong collaboration with AI teams to govern schemas and quality metrics.

Responsibilities

• Execute annotation, evaluation, and validation activities for AI-powered solutions using established guidelines and quality standards.
• Validate AI-generated outputs against predefined golden questions and expected results.
• Create, maintain, and review annotations to support AI model evaluation and continuous improvement.
• Test and evaluate Databricks Genie responses for accuracy, completeness, relevance, and consistency.
• Write and execute SQL queries against underlying data sources to validate answers generated from golden questions and Databricks Genie outputs.
• Investigate discrepancies between expected results, source data, and AI-generated responses, and document findings.

Skills

Annotation

SQL queries

AI model evaluation

Quality assurance

Collaboration

Tools

Databricks Genie

Job description

Sr. Engineer - Testing & Quality Assurance P

Ready to turn bold ideas into real-world impact?
At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it. Genpact’s AI Gigafactory, our industry-first accelerator, exemplifies how we scale advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. Whether tackling complex challenges through large-scale models or agentic AI, our breakthrough solutions tackle companies’ most complex challenges.
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting‑edge AI solutions, and want to push the boundaries of what’s possible, this is your moment.
Genpact (NYSE: G) is an agentic and advanced technology solutions company. We leverage process intelligence and artificial intelligence to deliver measurable outcomes.

Job Description

Responsibilities

• Execute annotation, evaluation, and validation activities for AI-powered solutions using established guidelines and quality standards.
• Validate AI-generated outputs against a predefined set of golden questions and expected results.
• Create, maintain, and review annotations to support AI model evaluation and continuous improvement.
• Test and evaluate Databricks Genie responses for accuracy, completeness, relevance, and consistency.
• Write and execute SQL queries against underlying data sources to validate answers generated from golden questions and Databricks Genie outputs.
• Investigate discrepancies between expected results, source data, and AI-generated responses, and document findings.
• Lead the design, optimization, and standardization of annotation processes and prompts across multiple AI use cases.
• Collaborate with AI teams to define and govern annotation schemas, taxonomies, evaluation frameworks, and quality standards.
• Review complex or high-risk AI outputs and provide expert quality assessments and recommendations.
• Ensure consistency, accuracy, traceability, and auditability of