Senior QA / Test Engineer - AI & Platform

Jobtailor; Greater London; On-site; GBP 55,000 - 85,000; Full time

Job summary

Jobtailor is seeking a QA/Test Automation Engineer to define and execute test strategies across applications, APIs, and AI-enabled workflows. You will develop automated coverage and support UAT, defect management, and release testing.

The role requires current SC clearance, strong API testing skills with Postman, experience with Playwright/Cypress/Selenium, SQL, CI/CD, and a solid understanding of modern web architectures. You will collaborate across engineering, product, and operations.

Qualifications

• Current SC Clearance required.
• Experience with QA, Test Engineering, or Test Automation within production applications.
• Experience with Playwright, Cypress, or Selenium.
• Strong API and integration testing using Postman or similar tools.
• Experience with SQL, CI/CD, and defect management tooling such as Jira or Azure DevOps.
• Good technical understanding of web applications, APIs, and modern application architectures.
• Understanding of AI evaluation concepts, including groundedness, relevance, hallucination testing, and retrieval quality.
• Strong analytical, problem-solving, and stakeholder communication skills.
• Experience testing Generative AI, LLM, or RAG solutions highly desirable.
• Python, TypeScript/JavaScript, or similar scripting experience advantageous.

Responsibilities

• Define and execute functional, integration, regression, and end-to-end test strategies
• Develop and maintain automated test coverage across applications, APIs, and workflows
• Support UAT, defect management, release testing, and production readiness
• Test APIs and integrations across internal and external services
• Validate AI-generated outputs for accuracy, relevance, consistency, and grounding
• Assess RAG and retrieval performance
• Establish repeatable evaluation approaches and datasets for AI-enabled functionality
• Investigate, reproduce, and resolve defects with engineering teams
• Provide quality evidence for release and go-live decisions
• Work with engineering, product, and operational teams throughout the development lifecycle

Education

Current SC Clearance

Tools

Postman

Jira

Azure DevOps

Playwright

Cypress

Selenium

Job description

• Define and execute functional, integration, regression, and end-to-end test strategies
• Develop and maintain automated test coverage across applications, APIs, and workflows
• Support UAT, defect management, release testing, and production readiness
• Test APIs and integrations across internal and external services
• Validate AI-generated outputs for accuracy, relevance, consistency, and grounding
• Assess RAG and retrieval performance
• Establish repeatable evaluation approaches and datasets for AI-enabled functionality
• Investigate, reproduce, and resolve defects with engineering teams
• Provide quality evidence for release and go-live decisions
• Work with engineering, product, and operational teams throughout the development lifecycle

Requirements

• Current SC Clearance required
• Strong experience in QA, Test Engineering, or Test Automation within production applications
• Experience with Playwright, Cypress, or Selenium
• Strong API and integration testing skills using Postman or similar tools
• Experience with SQL, CI/CD, and defect management tooling such as Jira or Azure DevOps
• Good technical understanding of web applications, APIs, and modern application architectures
• Understanding of AI evaluation concepts, including groundedness, relevance, hallucination testing, and retrieval quality
• Strong analytical, problem-solving, and stakeholder communication skills
• Experience testing Generative AI, LLM, or RAG solutions highly desirable
• Python, TypeScript/JavaScript, or similar scripting experience advantageous

Core Competencies

Demonstrates expertise in defining and executing comprehensive testing strategies, including functional, integration, and regression testing, while ensuring high-quality standards for AI-generated outputs and application performance. Proficient in utilizing automation tools and methodologies to enhance testing efficiency and accuracy across various platforms.

Highest-signal resume keywords

• QA Test Engineering
• Test Automation
• API Testing
• Playwright Cypress Selenium
• SC Clearance

ATS Optimization Keywords

Hard Skills

• Test Strategy Development
• Automated Test Coverage
• Defect Management
• SQL
• CI/CD
• Python
• TypeScript
• JavaScript
• AI Evaluation Concepts
• Integration Testing

Soft Skills

• Analytical Skills
• Problem-Solving
• Stakeholder Communication

Certifications & Qualifications

• Current SC Clearance

Industry Keywords

• Generative AI
• LLM
• RAG Solutions
• Web Applications
• Modern Application Architectures

Tools & Technologies

• Postman
• Jira
• Azure DevOps