Senior QA Engineer for AI and API Validation

Ubds-Group; Greater London; On-site; GBP 65,000 - 90,000; Full time

Job summary

UBDS Group is seeking an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform. You will define and execute test strategies across application functionality, workflows and integrations, collaborating with engineering, product and operations teams throughout the development lifecycle.

The role combines traditional software testing with evaluation of AI and retrieval-based functionality.

Qualifications

• Experience in QA, Test Engineering or Test Automation for production applications.
• Experience with test automation frameworks (Playwright, Cypress or Selenium).
• Strong API and integration testing skills using Postman.
• Experience with SQL, CI/CD and defect tools (Jira or Azure DevOps).
• Good understanding of web apps, APIs and modern architectures.
• Experience testing Generative AI/LLM/RAG is a plus.
• Understanding AI evaluation concepts (groundedness, relevance, hallucination testing, retrieval quality).
• Programming or scripting in Python, TypeScript/JavaScript is advantageous.
• Strong analytical, problem-solving and stakeholder communication.

Responsibilities

• Define and execute test strategies across functionality, workflows and integrations.
• Develop and maintain automated test coverage for applications, APIs and workflows.
• Support UAT, defect management, release testing and production readiness.
• Test APIs and integrations across internal and external services.
• Validate AI-generated outputs for accuracy, relevance, consistency and grounding.
• Assess RAG and retrieval performance for relevant information retrieval.
• Establish repeatable evaluation approaches and datasets for AI-enabled features.
• Work with engineering to investigate, reproduce and resolve defects.
• Provide clear quality evidence to support release and go-live decisions.

Skills

QA

Test Automation

API testing

CI/CD

Problem solving

Stakeholder communication

Python/TypeScript

Tools

Playwright

Cypress

Selenium

Postman

Jira

Azure DevOps

Job description

UBDS Group is seeking an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform. You will define and execute test strategies across application functionality, workflows and integrations, collaborating with engineering, product and operations teams throughout the development lifecycle.

The role combines traditional software testing with evaluation of AI and retrieval-based functionality.