Senior QA Engineer: AI & Omnichannel Testing Lead

Academic Key; Sheet; Remote; GBP 65,000 - 90,000; Full time

Job summary

Keyloop, in the UK, is seeking a Senior QA Engineer to own the quality strategy for our AI agent platform, spanning backend services, orchestration, and omnichannel communications. You will collaborate with engineers and product teams to build quality in from the start and design tests for non-deterministic AI outputs.

Responsibilities include creating automated tests across TypeScript/Node.js/React/Python, evaluating agent behavior, and ensuring robust API and database testing.

Qualifications

• Proven experience as a Senior QA Engineer on complex, production software products.
• Hands-on with test frameworks (Playwright, Cypress, Jest).
• Experience testing APIs, backend services, and PostgreSQL or similar.
• Ability to design and implement QA strategy.
• Strong communication to explain quality risks to engineers and stakeholders.

Responsibilities

• Design and own the quality strategy for our AI agent platform, including approaches to testing non-deterministic, LLM-powered systems.
• Build and maintain automated test suites covering unit, integration, API, and end-to-end scenarios across our TypeScript/Node.js/React/Python stack.
• Develop evaluation frameworks for agent behaviour, testing reasoning quality, tool use, memory, and multi-step interaction flows.
• Test and validate our omnichannel communication platform across channels: web, messaging, voice, and beyond.
• Collaborate closely with engineers and define acceptance criteria that catch issues early in the development cycle.
• Champion a culture of quality across the team, reviewing test coverage in PRs, advocating for testability in system design, and raising the bar for what "done" means.
• Use and help shape AI-assisted testing tooling to accelerate coverage and surface issues faster.

Skills

Test automation

QA strategy

Non-deterministic testing

Tools

Playwright

Cypress

Jest

PostgreSQL

Job description

Keyloop, in the UK, is seeking a Senior QA Engineer to own the quality strategy for our AI agent platform, spanning backend services, orchestration, and omnichannel communications. You will collaborate with engineers and product teams to build quality in from the start and design tests for non-deterministic AI outputs.

Responsibilities include creating automated tests across TypeScript/Node.js/React/Python, evaluating agent behavior, and ensuring robust API and database testing.