Tech Lead - Testing & Quality Assurance P 4C

3502 Servicios Internacionales De Atencion Al Cliente, Limitada; England; On-site; GBP 90,000 - 120,000; Full time

Job summary

Genpact in the United Kingdom is seeking a Tech Lead for Testing & Quality Assurance to guide AI-powered annotation and evaluation efforts. This role focuses on leading design, validation, and governance of QA processes across multiple AI use cases, collaborating with AI teams, data scientists, and product stakeholders.

You will mentor junior annotators and prompt engineers while driving continuous process improvement and responsible AI practices in a fast-moving, innovation-driven environment.

Qualifications

• Bachelors or Masters in relevant engineering/IT fields.
• Strong SQL and data QA testing capabilities.
• Experience with AI/ML data annotation and evaluation processes.

Responsibilities

• Execute annotation, evaluation, and validation activities for AI-powered solutions using guidelines and quality standards.
• Validate AI-generated outputs against golden questions and expected results.
• Create, maintain, and review annotations to support AI model evaluation and continuous improvement.
• Test and evaluate Databricks Genie responses for accuracy, completeness, relevance, and consistency.
• Write and execute SQL queries against underlying data sources to validate answers generated from golden questions and Databricks Genie outputs.
• Investigate discrepancies between expected results, source data, and AI-generated responses, and document findings.
• Lead the design, optimization, and standardization of annotation processes and prompts across multiple AI use cases.
• Collaborate with AI teams to define and govern annotation schemas, taxonomies, evaluation frameworks, and quality standards.
• Review complex or high-risk AI outputs and provide expert quality assessments and recommendations.
• Ensure consistency, accuracy, traceability, and auditability of annotation and evaluation results.
• Define reusable prompt frameworks and best practices aligned with business, compliance, and responsible AI objectives.
• Evaluate prompt performance and annotation quality metrics, identifying opportunities for improvement through data-driven insights.
• Establish quality benchmarks, calibration processes, and escalation procedures.
• Identify bias, hallucinations, and other AI risks, and recommend mitigation strategies.
• Support AI governance, compliance, and responsible AI initiatives.
• Participate in calibration sessions to align on annotation standards, quality expectations, and evaluation criteria.
• Collaborate closely with AI engineers, data scientists, product teams, and business stakeholders.
• Drive continuous process improvement through learning new AI technologies, annotation methodologies, and delivery approaches.
• Mentor and coach junior and intermediate annotators and prompt engineers.

Skills

Data Annotation

Databricks AI/BI Genie

SQL Query Writing

Education

Bachelors - Computer Engineering

Bachelors - Computer Science

Bachelors - Information Technology

Masters - Software Engineering

Job description

Tech Lead - Testing & Quality Assurance P

Ready to turn bold ideas into real-world impact?

At Genpact, we don't just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we're at the frontier of it. Genpact's AI Gigafactory, our industry-first accelerator, exemplifies how we scale advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. Whether tackling complex challenges through large-scale models or agentic AI, our breakthrough solutions tackle companies' most complex challenges.

If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting‑edge AI solutions, and want to push the boundaries of what's possible, this is your moment.

Genpact (NYSE: G) is an agentic and advanced technology solutions company. We leverage process intelligence and artificial intelligence to deliver measurable outcomes. With a strong partner ecosystem and decades of client trust, we provide innovative solutions that transform how businesses run. Powered by a team with an active learning mindset and client centricity at its core, we deliver lasting value for the world's leading enterprises.

Get to know us at genpact.com and on LinkedIn, YouTube, X, and Facebook.

Job Description

Responsibilities

• Execute annotation, evaluation, and validation activities for AI‑powered solutions using established guidelines and quality standards.
• Validate AI‑generated outputs against a predefined set of golden questions and expected results.
• Create, maintain, and review annotations to support AI model evaluation and continuous improvement.
• Test and evaluate Databricks Genie responses for accuracy, completeness, relevance, and consistency.
• Write and execute SQL queries against underlying data sources to validate answers generated from golden questions and Databricks Genie outputs.
• Investigate discrepancies between expected results, source data, and AI‑generated responses, and document findings.
• Lead the design, optimization, and standardization of annotation processes and prompts across multiple AI use cases.
• Collaborate with AI teams to define and govern annotation schemas, taxonomies, evaluation frameworks, and quality standards.
• Review complex or high‑risk AI outputs and provide expert quality assessments and recommendations.
• Ensure consistency, accuracy, traceability, and auditability of annotation and evaluation results.
• Define reusable prompt frameworks and best practices aligned with business, compliance, and responsible AI objectives.
• Evaluate prompt performance and annotation quality metrics, identifying opportunities for improvement through data‑driven insights.
• Establish quality benchmarks, calibration processes, and escalation procedures.
• Identify bias, hallucinations, and other AI risks, and recommend mitigation strategies.
• Support AI governance, compliance, and responsible AI initiatives.
• Participate in calibration sessions to align on annotation standards, quality expectations, and evaluation criteria.
• Collaborate closely with AI engineers, data scientists, product teams, and business stakeholders.
• Drive continuous process improvement through learning new AI technologies, annotation methodologies, and delivery approaches.
• Mentor and coach junior and intermediate annotators and prompt engineers.

Qualifications

• Bachelors - Computer Engineering
• Bachelors - Computer Science
• Bachelors - Information Technology
• Masters - Software Engineering

Certifications

• Certified Software Quality Analyst (CSQA) - RomtrainingRomtraining
• Certified Software Tester (CSTE) - TricentisTricentis
• Hexawise Test Professional Certification - HexawiseHexawise
• ISTQB Certified Tester - International Society for Technology in Education (ISTE)International Society for Technology in Education (ISTE)
• Selenium Basics - Great LearningGreat Learning

Required Skills

• Data Annotation
• Databricks AI/BI Genie
• SQL Query Writing

Language

English

Language Proficiency

Advanced - C1

Job Type

Fixed Term (Fixed Term)

Job End Date

2027-03-22

Master Skill List

Testing & Quality Assurance P

Remote Type

Office

Work Shift

Standard (United Kingdom)

Additional Job Location

-

Why join Genpact?

• Lead AI‑powered transformation - Drive innovation and solve real‑world business challenges that matter
• Make an impact - Help global enterprises solve business challenges that matter
• Accelerate your career - Gain hands‑on experience, mentorship, and world‑class learning opportunities to stay ahead
• Work with the best - Join 140,000+ bold thinkers and problem‑solvers who push boundaries every day
• Thrive in a values‑driven culture - Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress

Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up. Let's build tomorrow together. Genpact is an Equa