Senior QA Engineer - AI, API & RAG Testing (SC Cleared)

UBDS Digital; Greater London; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Private medical cover

Discretionary bonus

25 days holiday + birthday + work-ann.

EV salary sacrifice

Contributed pension

Death in service cover

Job summary

UBDS Group is seeking an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform. You will define and execute test strategies across applications, workflows and integrations, working closely with engineering, product and operational teams throughout the development lifecycle.

The role combines traditional software testing with the evaluation of AI and retrieval-based functionality.

Qualifications

• Extensive experience in QA, test engineering or test automation on production apps.
• Experience with Playwright, Cypress or Selenium.
• Strong API/integration testing using Postman.
• Experience with SQL, CI/CD and Jira/Azure DevOps.
• Knowledge of web apps, APIs and modern architectures.
• Experience testing Generative AI/LLM/RAG is desirable.
• Familiarity with AI evaluation concepts including groundedness and retrieval quality.
• Scripting in Python/TypeScript/JavaScript is advantageous.
• Strong analytical, problem-solving and stakeholder communication skills.

Responsibilities

• Define and execute test strategies covering functional, integration, regression and end-to-end testing.
• Develop and maintain automated test coverage across applications, APIs and workflows.
• Support UAT, defect management, release testing and production readiness.
• Test APIs and integrations across internal and external services.
• Validate AI-generated outputs for accuracy, relevance, consistency and grounding.
• Assess RAG and retrieval performance, ensuring relevant information is retrieved and used appropriately.
• Establish repeatable evaluation approaches and datasets for AI-enabled functionality.
• Work with engineering teams to investigate, reproduce and resolve defects.
• Provide clear quality evidence to support release and go-live decisions.

Skills

QA/Test Eng

Test Automation

AI/ML testing

API testing

CI/CD

Jira/Azure DevOps

SQL

Python/TS/JS scripting

Tools

Playwright

Cypress

Selenium

Postman

SQL

Jira/Azure DevOps

CI/CD

Job description

UBDS Group is seeking an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform. You will define and execute test strategies across applications, workflows and integrations, working closely with engineering, product and operational teams throughout the development lifecycle.

The role combines traditional software testing with the evaluation of AI and retrieval-based functionality.