Senior QA/Test Engineer

iO Associates; Greater London; On-site; GBP 70,000 - 95,000; Full time

Job summary

iO Associates seeks an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform in London. You will define and execute test strategies, develop automated coverage across applications and APIs, and collaborate with engineering, product and operations through the full lifecycle, including AI and retrieval-based functionality.

The role requires SC Clearance and a hands-on approach to ensure robust release quality and

Qualifications

• Extensive QA/testing experience in production applications.
• Proficient in Playwright, Cypress or Selenium.
• Strong API and integration testing with Postman.
• Experience with SQL, CI/CD and issue tracking (Jira/Azure DevOps).
• Experience with Generative AI / AI testing is a plus.

Responsibilities

• Define and execute test strategies covering functional, integration, regression and end-to-end testing.
• Develop and maintain automated test coverage across applications, APIs and workflows.
• Support UAT, defect management, release testing and production readiness.
• Test APIs and integrations across internal and external services.
• Validate AI-generated outputs for accuracy, relevance, consistency and grounding.
• Assess RAG and retrieval performance, ensuring relevant information is retrieved and used appropriately.
• Establish repeatable evaluation approaches and datasets for AI-enabled functionality.
• Work with engineering teams to investigate, reproduce and resolve defects.
• Provide clear quality evidence to support release and go-live decisions.

Skills

QA

Test Automation

Playwright

Cypress

Selenium

Postman

API testing

SQL

CI/CD

Jira

Azure DevOps

AI testing

RAG testing

Tools

Playwright

Cypress

Selenium

Postman

SQL tooling

Jira

Azure DevOps

Job description

We are recruiting on behalf of our client for an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform.

You will define and execute test strategies across application functionality, workflows and integrations, working closely with engineering, product and operational teams throughout the development lifecycle. The role combines traditional software testing with the evaluation of AI and retrieval-based functionality.

Due to the nature of the programme, candidates must hold current SC Clearance.

What You’ll Be Doing

• Define and execute test strategies covering functional, integration, regression and end-to-end testing.
• Develop and maintain automated test coverage across applications, APIs and workflows.
• Support UAT, defect management, release testing and production readiness.
• Test APIs and integrations across internal and external services.
• Validate AI-generated outputs for accuracy, relevance, consistency and grounding.
• Assess RAG and retrieval performance, ensuring relevant information is retrieved and used appropriately.
• Establish repeatable evaluation approaches and datasets for AI-enabled functionality.
• Work with engineering teams to investigate, reproduce and resolve defects.
• Provide clear quality evidence to support release and go-live decisions.

What We’re Looking For

• Strong experience in QA, Test Engineering or Test Automation within production applications.
• Experience with test automation frameworks such as Playwright, Cypress or Selenium.
• Strong API and integration testing skills using tools such as Postman.
• Experience with SQL, CI/CD and defect management tooling such as Jira or Azure DevOps.
• Good technical understanding of web applications, APIs and modern application architectures.
• Experience testing Generative AI, LLM or RAG solutions would be highly desirable.
• Understanding of AI evaluation concepts including groundedness, relevance, hallucination testing and retrieval quality.
• Strong analytical, problem-solving and stakeholder communication skills.