AI Quality Engineer (UK Remote)

ZipRecruiter; Ashton-under-Lyne; Remote; GBP 50,000 - 75,000; Full time

Job summary

A leading company in the technology sector is seeking a Quality Engineer to oversee the assurance of software quality within their development team. The ideal candidate will possess strong experience in web application testing, automation, and data analysis, with a focus on AI detection systems. Responsibilities include collaborating across teams, implementing automation strategies, and conducting thorough data analysis to enhance quality standards.

Qualifications

• 3+ years of experience in web application testing, automation, and data analysis.
• Proficient in developing automated tests using Python or Java.
• Experience with prompt engineering and APIs.

Responsibilities

• Stay updated on AI detection trends and share findings with the team.
• Aggregate and analyse data to uncover vulnerabilities in AI detection mechanisms.
• Identify automation opportunities for testing AI detection systems.

Skills

Web application testing

Automation

Data analysis

Python

Java

Git

API testing

Communication

Excel

Job description

Job Description

Job Description

The department of Quality Engineering (under Technology) plays a crucial role in the software development process. This department is primarily responsible for ensuring that software products being developed within the Technology org at Turnitin meet or exceed predetermined quality standards.

Responsibilities:

• Research: Stay updated on trends and techniques related to bypassing AI detection systems; proactively share relevant findings with the team.
• Data Analysis: Aggregate, organise, and analyse data to uncover patterns, trends, and vulnerabilities in AI detection mechanisms.
• Automation & Solution Strategy: Identify high-ROI automation opportunities for testing AI detection systems. Develop, maintain, and improve automated test coverage and contribute to overall solution design.
• Team Collaboration: Act as a central communication point between technical and non-technical team members to ensure alignment and information flow.
• Documentation & Process Improvement: Create, maintain, and regularly update clear documentation and reports covering methods, tools, test strategies, vulnerabilities, and impact assessments; continuously improve related processes to meet evolving needs.
• Knowledge Sharing: Provide guidance and occasional training to team members on recognising and responding to new bypass techniques.

Qualifications

Requirements:

• 3+ years of combined experience in web application testing, automation, and data analysis.
• Proven ability to develop and maintain automated tests (using Python or Java, Pytest, REST Assured, or similar), including integration with REST APIs.
• Experience with prompt engineering and LLM APIs.
• Understanding of the ML lifecycle (training, fine-tuning, eval), Generative AI, and related technologies.
• Capable of analysing complex datasets to identify patterns, trends, and anomalies related to AI detection bypass techniques.
• Experience with version control (Git) and CI/CD pipelines.
• Experience with API testing.
• Excellent written and verbal English for effective cross-team communication, including with non-technical stakeholders.
• Working knowledge of Excel or Google Sheets (including formulas).
• Experience leading or mentoring teams in test automation initiatives.

Nice to Have:

• Exposure to security testing or red-teaming, especially related to NLP or AI systems.

Additional Information