Senior Tester (AI)

Liaison Group; Tring; Remote; GBP 60,000 - 90,000; Full time

Job summary

Liaison Group in the UK is seeking a Senior Tester (AI) to lead testing of AI-powered products, combining manual and automated approaches while collaborating with developers, product owners and stakeholders.

You will drive quality across the development lifecycle, ensure reliability, performance and safety of AI solutions, and champion test-driven practices and regulatory alignment.

This role offers remote working within the UK and a collaborative, fast-paced environment at Liaison Group.

Qualifications

• Experience testing non-deterministic AI systems using statistical and dataset-based techniques.
• Experience testing Generative AI or Copilot solutions.
• Knowledge of AI security testing and OWASP LLM Top 10 style risks.
• Familiarity with common AI failure modes, including hallucination and model drift.
• Experience in web-based software and API testing.
• Experience handling NHS patient data.

Responsibilities

• Plan test scope and scenarios with stakeholders.
• Write test cases and document results.
• Maintain automated test framework and scripts.
• Ensure software meets functional and non-functional requirements.
• Support regulatory compliance documentation.

Skills

AI testing

Generative AI

Security testing

Web testing

Agile testing

Test automation

NHS data handling

Education

BSc in Computer Science

ISTQB Foundation

Tools

Playwright

Cucumber

Selenium

Appium

Azure DevOps

Job description

About UsWe are a well-established and trusted health economy partner, saving millions for reinvestment in health and social care through our Workforce, Financial, Care and Specialty Transformation businesses.

About UsWe are a well-established and trusted health economy partner, saving millions for reinvestment in health and social care through our Workforce, Financial, Care and Specialty Transformation businesses. We are dedicated to improving the health economy through expert advisors, established technology, and best practice process improvement. Our work has also been recognised with numerous HR and Finance industry awards. As a base all our employees work from the comfort of their own home. We now have over 400 employees based across the length and breadth of the UK, enjoying the flexibility of working remotely. We are proud to say that we are currently the: #1 Best Large Company To Work For in the UK #1 Best Consultancy To Work For in the UK We are a 3-star (out of 3) rated company by Best Companies, recognising Liaison Group as a 'World-class Company to Work For'.

Job SummaryWe're looking for a talented Senior Tester (AI) to play a key role in the implementation, testing, and continuous improvement of Liaison Care's innovative AI-powered products. Working closely with developers, product owners, and stakeholders, you'll ensure our AI solutions are robust, reliable, and deliver an outstanding user experience. You'll lead both manual and automated testing activities, help drive quality throughout the development lifecycle, and champion best practices including test-driven development.

PRINCIPAL TASKS & ACTIVITIES

• Continuously adopt proven AI testing strategies, techniques and industry best practices, proactively improving the quality, reliability, safety and performance of AI-powered solutions.
• Undertake test planning activities for Agile deliveries.
• Add test scripts and maintain Automated test framework.
• Plan own workload and scope/requirements.
• Analyse functional and technical specifications and user stories to derive test cases and scenarios.
• Participate in document and peer reviews.
• Agree test scope and scenarios with key stakeholder/clients.
• Identify issues and risks relating to workload, **escalate** these appropriately and provide suggested mitigating actions.
• Review own test conditions, test scripts / user stories, input test data, and expected results for all test phases.
• Effectively prepare regression, ad hoc and re-tests as required.
• Ensure software meets functional and non-functional requirements.
• Write test cases and document results in accordance with company standards.
• Maintain comprehensive and auditable test documentation to support regulatory compliance, including requirement for medical device standards where applicable.
• Help refine user stories by working with the product owner and developers.

Experience

Essential:

• Experience of testing and evaluating non-deterministic AI systems using statistical and dataset-based techniques to assess quality, reliability, accuracy and performance.
• Experience testing Generative AI or Copilot solutions.
• Knowledge of AI security testing and red-teaming practices, including OWASP LLM Top 10 style risks.
• Familiarity with common AI failure modes, including hallucination, retrieval failures, grounding issues, prompt injection, safety concerns, model drift and regression following prompt or model changes.
• Previous experience in web-based Software and API testing.
• Experience testing products that process highly sensitive data, for example NHS Patient Identifiable Data.
• Experience in, and understanding of, the software development process, preferably in a web based (SAAS) environment.
• Knowledge and practical experience of test tools and industry standard best practice.
• Knowledge or experience of the agile development processes (e.g. Scrum).

Desirable:

• Experience of Microsoft's AI evaluation and testing tools.
• Experience testing RAG and agent-based solutions
• Experience performing bias, safety and security testing
• Experience testing Power Apps, Power Automate, Copilot Studio agents.
• Experience testing and validating data across Microsoft Fabric, SQL, Cosmos and Dataverse, including processes, integrations and end-to-end data flows.
• Experience working with the NHS or within the health technology sector.
• Working knowledge of Test Automation (e.g. Copilot Studio Agents Evaluations, Playwright (C#), Cucumber, Selenium, Appium).
• Experience using Azure DevOps.

Skills & Competencies

• Ability to work in a dynamic and fast paced environment.
• Highly motivated self-starter.
• Strong verbal and written communication skills.
• Ability to work within an agile team and communicate detailed feedback to developers constructively.
• Good attention to detail.
• Be self-motivated and inquisitive, able to work independently.

Qualifications & Training

Essential:

• ISTQB Foundation Level Certification
• BSc in Computer Science or equivalent.

Desirable:

• ISTQB CT-AI
• Microsoft AI-900: Azure AI Fundamentals.
• Microsoft AI-102: Azure AI Engineer.

OUR VALUES You will be expected to demonstrate Liaison's core values: Care, Honesty, Inspire and Guide, and embody our behaviours-be present, choose your attitude, make someone's day, and have fun.

We are proud to support our colleagues and will offer an interview to any candidate with a disability, should they match the skills and experience required for the role.

Liaison Group is committed to creating a diverse and inclusive environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment regardless of race, colour, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We pride ourselves on being a place where we can all be ourselves and succeed on merit.

Liaison Group are committed to the Good Recruitment Campaign and are official signatories for the Good Recruitment Charter.

We reserve the right to close this vacancy early if we receive a high volume of applications.

Thank you for your interest in joining Liaison Group

If you have any questions or require any further information, please feel free to contact us at [e-mail].