QA Automation Engineer - Playwright, API Contracts & CI/CD

Lyrebird Health; United Kingdom; On-site; GBP 55,000 - 75,000; Full time

Job summary

Lyrebird Health seeks a Quality Assurance Engineer (Automation) to own the platform's quality from commit to release. You’ll develop fast, reliable Playwright suites and contract tests that guard against backend changes, while evaluating AI outputs for clinical safety.

You’ll collaborate with SRE and engineering to ensure robust, production-like test code. You’ll switch between TypeScript and Python, cutting flaky tests and accelerating pipelines, with an emphasis on measurable signals and

Qualifications

• Strong test automation experience in TypeScript and Python.
• Hands-on Playwright experience with component testing.
• Solid pytest skills including async tests, fixtures, mocking and data factories.
• Experience running tests in CI pipelines (Buildkite) and in Docker.
• Working knowledge of SQL and PostgreSQL and testing at the database layer.
• Experience with API contract testing against OpenAPI schemas.

Responsibilities

• Optimise Playwright end-to-end suite to reduce run time and flaky tests.
• Extend API and partner integration suites and build contract tests from OpenAPI schemas.
• Add coverage gates to Buildkite pipelines and report quality by product area.
• Support CI/CD development and oversight with engineering teams.
• Test clinical model outputs using DeepEval, openevals and Langfuse traces.
• Run Locust load tests ahead of major releases and report findings to SRE.
• Build signals for SRE: health checks, synthetic monitors and post-deployment tests.
• Own the release quality gate with evidence-backed decisions.
• Raise testing standards across engineering through patterns, fixtures and code reviews.

Skills

TypeScript

Python

Playwright

Vitest

Testing Library

pytest

CI/CD

Docker

SQL

OpenAPI

API contract testing

Tools

Buildkite

OpenAPI

PostgreSQL

Locust

Job description

Lyrebird Health seeks a Quality Assurance Engineer (Automation) to own the platform's quality from commit to release. You’ll develop fast, reliable Playwright suites and contract tests that guard against backend changes, while evaluating AI outputs for clinical safety.

You’ll collaborate with SRE and engineering to ensure robust, production-like test code. You’ll switch between TypeScript and Python, cutting flaky tests and accelerating pipelines, with an emphasis on measurable signals and