Software quality engineer (UK)

Neura Market; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Generous PTO

Comprehensive medical and dental

Parental leave

Fertility and family planning support

Galleri cancer testing

Pension scheme

Annual stipends

Off-sites

Stock options

Job summary

WRITER is seeking a Software Quality Engineer to shape reliability and trust in our AI-powered work orchestration platform. You’ll define QA strategies, build automation, and collaborate with product and ML teams to validate complex AI features.

Based in our London hub with hybrid work options, you will own testing across CI/CD, data pipelines, and defect management, driving quality through scalable frameworks and robust test data.

Qualifications

• 5+ years of hands-on experience in software quality assurance or engineering, specializing in testing distributed AI/ML systems.
• Proficiency with GitHub Actions and modern testing frameworks; Python or TypeScript for automation.
• Strong understanding of AI/ML concepts, data pipelines, model evaluation metrics, and testing generative AI outputs.

Responsibilities

• Define and implement QA strategies and test plans for AI agents and LLM-powered applications to ensure reliability and performance.
• Design and develop automation frameworks; build robust, scalable testing infrastructure.
• Collaborate with product, ML engineering, and data science teams to translate AI features into test criteria and validation plans.
• Integrate automated checks in CI/CD to accelerate high-quality releases.
• Identify, document, and track defects; perform root cause analysis and communicate findings to development teams.
• Monitor production AI model performance and post-release quality validation.

Skills

Python

TypeScript

Playwright

GitHub Actions

CI/CD

Quality assurance

Tools

Playwright

Docker

Kubernetes

AWS

Azure

GCP

Job description

About WRITER

WRITER is where the world's leading enterprises orchestrate AI-powered work. Our vision is to expand human capacity through superintelligence. And we're proving it's possible – through powerful, trustworthy AI that unites IT and business teams together to unlock enterprise-wide transformation. With WRITER's end-to-end platform, hundreds of companies like Mars, Marriott, Uber, and Vanguard are building and deploying AI agents that are grounded in their company's data and fueled by WRITER's enterprise-grade LLMs. Valued at $1.9B and backed by industry-leading investors including Premji Invest, Radical Ventures, and ICONIQ Growth, WRITER is rapidly cementing its position as the leader in enterprise generative AI.

Founded in 2020 with office hubs in San Francisco, New York City, Seattle, Austin, Chicago, and London, our team thinks big and moves fast, and we're looking for smart, hardworking builders and scalers to join us on our journey to create a better future of work with AI.

About the role

Are you passionate about ensuring the highest quality for cutting-edge generative AI applications? As a software quality engineer at WRITER, you'll play a critical role in shaping the reliability, performance, and trustworthiness of our AI-powered work orchestration platform. You’ll be at the forefront of defining and implementing rigorous quality strategies for our enterprise-grade LLMs and AI agents, directly impacting how hundreds of global companies unlock transformational value through AI. This is a unique chance to dive deep into the unique challenges of AI quality assurance and make a tangible difference in a rapidly evolving field.

This is a hybrid role based out of our London, San Francisco, Seattle, and New York City hubs. You will report directly to the director of engineering.

What you'll do

• Define and implement comprehensive quality assurance strategies and test plans for our AI agents and LLM-powered applications, ensuring exceptional product reliability and performance.

• Designing and developing automation frameworks: creating robust, scalable, and maintainable automated test frameworks from scratch or enhancing existing ones. You’ll need proficiency in at least one language like Typsecript, Python.

• Collaborate closely with product managers, machine learning engineers, and data scientists to understand complex AI features and model behaviors, translating them into effective test cases and validation criteria.

• Drive the continuous improvement of our testing processes and infrastructure, integrating automated checks within our CI/CD pipelines to ensure rapid, high-quality releases.

• Identify, document, and track software defects and inconsistencies, performing root cause analysis to provide actionable feedback to development teams.

• Monitor production systems and AI model performance, proactively identifying potential issues and contributing to post-release quality validation.

• Champion quality best practices across engineering teams, fostering a culture of ownership and continuous improvement in delivering world-class AI solutions.

• Designing, managing, and maintaining test data strategies and mock services to ensure stable, isolated, and repeatable test execution.

• Experience designing, developing, or integrating agentic AI systems, AI skills, and the Model Context Protocol (MCP).

• Manage the full defect lifecycle by analyzing customer feedback and debugging logs to identify, prioritize, and track software bugs, collaborating closely with development teams to ensure timely resolution.

What you need

• 5+ years of hands-on experience in software quality assurance or engineering, with a strong focus on testing complex distributed systems or AI/ML applications.

• 5+ years of experience working with GitHub actions

• Proficiency in programming languages like Python or Typescript for test automation, and experience with modern testing frameworks such as Playwright.

• Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and the unique challenges of testing generative AI outputs.

• Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment is a big plus.

• Exceptional analytical skills to dissect complex problems and a keen eye for detail, ensuring no bug goes unnoticed.

• A collaborative spirit that helps you Connect cross-functional teams to common quality goals, Challenge existing assumptions to build better systems, and Own the end-to-end quality of our products.

• Demonstrated ability to drive initiatives independently and thrive in a fast-paced, evolving startup environment.

Benefits & perks (UK full-time employees):

• Generous PTO, plus company holidays

• Comprehensive medical and dental insurance

• Paid parental leave for all parents (16 weeks)

• Fertility and family planning support

• Early-detection cancer testing through Galleri

• Competitive pension scheme and company contribution

• Annual work-life stipends for:

  • Wellness stipend for gym, massage/chiropractor, personal training, etc.

  • Learning and development stipend

• Company-wide off-sites and team off-sites

• Competitive compensation and company stock options