AI Quality Engineer for Enterprise GenAI Platform

WRITER; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Generous PTO

Medical & dental insurance

Parental leave (16 weeks)

Fertility support

Cancer screening (Galleri)

Pension scheme

Annual stipends (wellness, learning)

Off-sites & team events

Stock options

Job summary

WRITER is seeking a Software Quality Engineer to shape the reliability, performance, and trustworthiness of our AI-powered work orchestration platform. You’ll define quality strategies for enterprise-grade LLMs and AI agents, impacting hundreds of global companies and their data-driven transformations.

The role is hybrid with hubs in London, San Francisco, Seattle, and NYC. You will report to the director of engineering and work closely with cross-functional teams to ensure world-class quality

Qualifications

• 5+ years hands-on experience in software quality assurance or engineering for distributed AI/ML systems.
• 5+ years of experience with GitHub Actions in CI/CD environments.
• Proficiency in Python or TypeScript for test automation and Playwright.
• Solid understanding of AI/ML concepts and model evaluation metrics.
• Experience with cloud platforms (AWS/Azure/GCP) and Docker/Kubernetes in CI/CD.

Responsibilities

• Define and implement comprehensive QA strategies for AI agents and LLM-powered apps, ensuring reliability and performance.
• Design and develop automation frameworks, scalable and maintainable, in Python/TypeScript.
• Collaborate with product managers, ML engineers and data scientists to translate features into tests.
• Improve testing processes and CI/CD pipelines to enable rapid, high-quality releases.
• Identify, document, and track defects; perform root-cause analysis for fixes.
• Monitor production systems and AI models, validate post-release quality.
• Promote quality best practices across teams and own end-to-end quality.
• Design and manage test data strategies and mocks for stable tests.
• Familiarity with agentic AI systems and MCP is a plus.

Skills

QA automation

Python/TypeScript

Playwright

GitHub Actions

CI/CD

AI/ML concepts

Cloud platforms

Docker/Kubernetes

Test planning

Tools

TypeScript

Playwright

CI/CD tooling

Job description

WRITER is seeking a Software Quality Engineer to shape the reliability, performance, and trustworthiness of our AI-powered work orchestration platform. You’ll define quality strategies for enterprise-grade LLMs and AI agents, impacting hundreds of global companies and their data-driven transformations.

The role is hybrid with hubs in London, San Francisco, Seattle, and NYC. You will report to the director of engineering and work closely with cross-functional teams to ensure world-class quality