Senior QA / Test Engineer - AI & Platform

UBDS Digital; Greater London; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Private medical cover

Discretionary bonus

25 days holiday + birthday + work-ann.

EV salary sacrifice

Contributed pension

Death in service cover

Job summary

UBDS Group is seeking an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform. You will define and execute test strategies across applications, workflows and integrations, working closely with engineering, product and operational teams throughout the development lifecycle.

The role combines traditional software testing with the evaluation of AI and retrieval-based functionality.

Qualifications

• Extensive experience in QA, test engineering or test automation on production apps.
• Experience with Playwright, Cypress or Selenium.
• Strong API/integration testing using Postman.
• Experience with SQL, CI/CD and Jira/Azure DevOps.
• Knowledge of web apps, APIs and modern architectures.
• Experience testing Generative AI/LLM/RAG is desirable.
• Familiarity with AI evaluation concepts including groundedness and retrieval quality.
• Scripting in Python/TypeScript/JavaScript is advantageous.
• Strong analytical, problem-solving and stakeholder communication skills.

Responsibilities

• Define and execute test strategies covering functional, integration, regression and end-to-end testing.
• Develop and maintain automated test coverage across applications, APIs and workflows.
• Support UAT, defect management, release testing and production readiness.
• Test APIs and integrations across internal and external services.
• Validate AI-generated outputs for accuracy, relevance, consistency and grounding.
• Assess RAG and retrieval performance, ensuring relevant information is retrieved and used appropriately.
• Establish repeatable evaluation approaches and datasets for AI-enabled functionality.
• Work with engineering teams to investigate, reproduce and resolve defects.
• Provide clear quality evidence to support release and go-live decisions.

Skills

QA/Test Eng

Test Automation

AI/ML testing

API testing

CI/CD

Jira/Azure DevOps

SQL

Python/TS/JS scripting

Tools

Playwright

Cypress

Selenium

Postman

SQL

Jira/Azure DevOps

CI/CD

Job description

Description

UBDS is looking for an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform.

UBDS is looking for an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform. You will define and execute test strategies across application functionality, workflows and integrations, working closely with engineering, product and operational teams throughout the development lifecycle. The role combines traditional software testing with the evaluation of AI and retrieval-based functionality. Due to the nature of the programme, candidates must hold current SC Clearance.

What you'll be doing

• Define and execute test strategies covering functional, integration, regression and end-to-end testing.
• Develop and maintain automated test coverage across applications, APIs and workflows.
• Support UAT, defect management, release testing and production readiness.
• Test APIs and integrations across internal and external services.
• Validate AI-generated outputs for accuracy, relevance, consistency and grounding.
• Assess RAG and retrieval performance, ensuring relevant information is retrieved and used appropriately.
• Establish repeatable evaluation approaches and datasets for AI-enabled functionality.
• Work with engineering teams to investigate, reproduce and resolve defects.
• Provide clear quality evidence to support release and go-live decisions.

What we're looking for

• Strong experience in QA, Test Engineering or Test Automation within production applications.
• Experience with test automation frameworks such as Playwright, Cypress or Selenium.
• Strong API and integration testing skills using tools such as Postman.
• Experience with SQL, CI/CD and defect management tooling such as Jira or Azure DevOps.
• Good technical understanding of web applications, APIs and modern application architectures.
• Experience testing Generative AI, LLM or RAG solutions would be highly desirable.
• Understanding of AI evaluation concepts including groundedness, relevance, hallucination testing and retrieval quality.
• Python, TypeScript/JavaScript or similar scripting experience would be advantageous.
• Strong analytical, problem-solving and stakeholder communication skills.

Benefits

Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability. UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

• Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.