SC Cleared: Senior QA & AI Test Engineer

UBDS Group; Manchester; On-site; GBP 65,000 - 80,000; Full time

Benefits offered by this job

Training

Private medical cover

Discretionary bonus

Holiday 25 days + birthday + workanniv

EV lease

Pension

Death in service

Job summary

UBDS Group is seeking a Senior QA/Test Engineer to drive quality and production readiness for a complex AI-enabled platform. You will define test strategies across applications, APIs and AI features, collaborating with engineering, product and operations throughout the lifecycle.

The role emphasizes automated test coverage, API testing, and evaluating AI outputs, RAG performance, and grounding. SC Clearance is required for the programme, with a strong focus on delivering reliable releases.

Qualifications

• 5+ years in QA, test engineering or test automation.
• Experience with test automation frameworks such as Playwright, Cypress or Selenium.
• Strong API and integration testing skills using Postman.
• Experience with SQL, CI/CD and defect management tooling such as Jira or Azure DevOps.
• Good technical understanding of web applications, APIs and modern architectures.
• Experience testing Generative AI, LLM or RAG solutions would be highly desirable.
• Understanding of AI evaluation concepts including groundedness, relevance and retrieval quality.
• Proficiency in scripting with Python or JavaScript/TypeScript.
• Strong analytical, problem-solving and stakeholder communication skills.

Responsibilities

• Define and execute test strategies covering functional, integration, regression and end-to-end testing.
• Develop and maintain automated test coverage across applications, APIs and workflows.
• Support UAT, defect management, release testing and production readiness.
• Test APIs and integrations across internal and external services.
• Validate AI-generated outputs for accuracy, relevance, consistency and grounding.
• Assess retrieval quality and data usage for AI-enabled features.
• Establish repeatable evaluation datasets for AI functionality.
• Collaborate with engineers to reproduce and resolve defects.
• Provide clear quality evidence to support release decisions.

Skills

QA experience

Test automation

API testing

CI/CD

Jira/Azure DevOps

Playwright/Cypress/Selenium

Postman

SQL

Python/TypeScript

AI/RAG testing

Debugging/triage

Tools

Playwright

Cypress

Selenium

Postman

Jira

Azure DevOps

Job description

UBDS Group is seeking a Senior QA/Test Engineer to drive quality and production readiness for a complex AI-enabled platform. You will define test strategies across applications, APIs and AI features, collaborating with engineering, product and operations throughout the lifecycle.

The role emphasizes automated test coverage, API testing, and evaluating AI outputs, RAG performance, and grounding. SC Clearance is required for the programme, with a strong focus on delivering reliable releases.