Senior QA & AI Test Engineer – SC Cleared

Jobtailor; Greater London; On-site; GBP 55,000 - 85,000; Full time

Job summary

Jobtailor is seeking a QA/Test Automation Engineer to define and execute test strategies across applications, APIs, and AI-enabled workflows. You will develop automated coverage and support UAT, defect management, and release testing.

The role requires current SC clearance, strong API testing skills with Postman, experience with Playwright/Cypress/Selenium, SQL, CI/CD, and a solid understanding of modern web architectures. You will collaborate across engineering, product, and operations.

Qualifications

• Current SC Clearance required.
• Experience with QA, Test Engineering, or Test Automation within production applications.
• Experience with Playwright, Cypress, or Selenium.
• Strong API and integration testing using Postman or similar tools.
• Experience with SQL, CI/CD, and defect management tooling such as Jira or Azure DevOps.
• Good technical understanding of web applications, APIs, and modern application architectures.
• Understanding of AI evaluation concepts, including groundedness, relevance, hallucination testing, and retrieval quality.
• Strong analytical, problem-solving, and stakeholder communication skills.
• Experience testing Generative AI, LLM, or RAG solutions highly desirable.
• Python, TypeScript/JavaScript, or similar scripting experience advantageous.

Responsibilities

• Define and execute functional, integration, regression, and end-to-end test strategies
• Develop and maintain automated test coverage across applications, APIs, and workflows
• Support UAT, defect management, release testing, and production readiness
• Test APIs and integrations across internal and external services
• Validate AI-generated outputs for accuracy, relevance, consistency, and grounding
• Assess RAG and retrieval performance
• Establish repeatable evaluation approaches and datasets for AI-enabled functionality
• Investigate, reproduce, and resolve defects with engineering teams
• Provide quality evidence for release and go-live decisions
• Work with engineering, product, and operational teams throughout the development lifecycle

Education

Current SC Clearance

Tools

Postman

Jira

Azure DevOps

Playwright

Cypress

Selenium

Job description

Jobtailor is seeking a QA/Test Automation Engineer to define and execute test strategies across applications, APIs, and AI-enabled workflows. You will develop automated coverage and support UAT, defect management, and release testing.

The role requires current SC clearance, strong API testing skills with Postman, experience with Playwright/Cypress/Selenium, SQL, CI/CD, and a solid understanding of modern web architectures. You will collaborate across engineering, product, and operations.