GenAI Test Lead

Capgemini; London; On-site; GBP 65,000 - 85,000; Full time

Job summary

Capgemini seeks a Test Lead to drive QA strategies for GPT-based applications in London. The role emphasizes defining testing frameworks, leading QA lifecycles, and ensuring compliance with responsible AI standards. Ideal candidates will offer strong expertise in test automation and generative AI workflows while working collaboratively in a cross-functional team.

Qualifications

• Proven experience as a Test Lead in GenAI or LLM-based applications.
• Strong understanding of LLMs and generative AI workflows.
• Experience in risk identification and mitigation for hallucinations and bias.

Responsibilities

• Define and document the testing strategy for GPT-based applications.
• Lead the end-to-end QA lifecycle for GenAI features.
• Ensure compliance with AI governance and data privacy standards.

Skills

Test automation

Python

Prompt engineering

Analytical skills

Communication

Tools

PyTest

Postman

LangChain testing utilities

Job description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Your Role

• Define and document the testing strategy for GPT-based applications, covering functional, non-functional, and ethical dimensions.
• Develop test plans, cases, and data focused on LLM-specific behaviors like prompt engineering, hallucination detection, and response consistency.
• Lead the end-to-end QA lifecycle for GenAI features, from requirements to post-deployment monitoring.
• Establish quality gates and acceptance criteria for LLM outputs, ensuring accuracy, safety, and fairness.
• Identify and implement AI-specific testing tools (e.g., prompt testing, adversarial testing).
• Integrate testing into CI/CD pipelines in collaboration with MLOps and DevOps teams.
• Ensure compliance with AI governance, data privacy, and responsible AI standards.
• Validate API integrations, including authentication, rate limits, and error handling.

Your Profile

• Proven experience as a Test Lead, preferably in GenAI or LLM-based applications.
• Strong understanding of LLMs, prompt engineering, and generative AI workflows.
• Skilled in test automation using tools like Python, PyTest, Postman, and LangChain testing utilities.
• Familiarity with OpenAI APIs, model fine-tuning, and evaluation techniques.
• Knowledge of AI ethics, bias detection, and responsible AI practices.
• Experience in risk identification and mitigation for hallucinations, bias, and toxicity in LLMs.
• Excellent analytical and communication skills for cross-functional collaboration.
• Ability to provide clear reporting on test coverage, quality metrics, and model behavior insights.

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than fifty countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

When you join Capgemini, you don’t just start a new job. You become part of something bigger.

Learn about how the recruitment process works – how to apply, where to follow your application, and next steps.

To help you bring out the best of yourself during the interview process, we’ve got some great interview tips to share before the big day.