AI Quality Engineer- Python or Java (UK Remote)

Turnitin, LLC; Newcastle upon Tyne; Remote; GBP 55,000 - 75,000; Full time

Job summary

A leading company in the global education sector is looking for an AI Quality Engineer. This fully remote position emphasizes innovation in testing AI detection systems, requiring robust experience in automation and data analysis. The role involves cross-team collaboration and the continuous improvement of testing processes, supported by a company culture that values integrity, learning, and ownership. Interested candidates are encouraged to apply, even if they do not meet every criterion.

Benefits

Health Care Coverage

Education Reimbursement

Competitive Paid Time Off

National Holidays

Monthly Wellness Reimbursement

Access to Mental Health Platform

Retirement Plan with Match

Qualifications

• 6+ years of web application testing, automation, and data analysis experience.
• Proven ability in developing automated tests using Python or Java.
• Strong knowledge in analyzing complex datasets and automation opportunities.

Responsibilities

• Research and analyze AI detection systems for vulnerabilities.
• Develop and maintain automated test coverage for AI detection.
• Collaborate with technical and non-technical team members.

Skills

Data Analysis

Automation

Team Collaboration

Documentation

Knowledge Sharing

Tools

Python

Java

Pytest

REST Assured

Excel

Google Sheets

Git

Job description

AI Quality Engineer- Python or Java (UK Remote)

• Full-time

When you join Turnitin, you'll be welcomed into a company that is a recognized innovator in the global education space. For over 25 years, Turnitin has partnered with educational institutions to promote honesty, consistency, and fairness across all subject areas and assessment types. Over 21,000 academic institutions, publishers, and corporations use our services: Feedback Studio, Originality, Gradescope, ExamSoft, Similarity, and iThenticate.

Experience a remote-centric culture that empowers you to work with purpose and accountability in a way that best suits you, supported by a comprehensive package that prioritizes your overall well-being. Our diverse community of colleagues are all unified by a shared desire to make a difference in education.

Turnitin is a global organization with team members in over 35 countries including the United States, Mexico, United Kingdom, Australia, Japan, India, and the Philippines.

The department of Quality Engineering (under Technology) plays a crucial role in the software development process. This department is primarily responsible for ensuring that software products being developed within the Technology org at Turnitin meet or exceed predetermined quality standards.

Responsibilities:

• Research: Stay updated on trends and techniques related to bypassing AI detection systems; proactively share relevant findings with the team.
• Data Analysis: Aggregate, organise, and analyse data to uncover patterns, trends, and vulnerabilities in AI detection mechanisms.
• Automation & Solution Strategy: Identify high-ROI automation opportunities for testing AI detection systems. Develop, maintain, and improve automated test coverage and contribute to overall solution design.
• Team Collaboration: Act as a central communication point between technical and non-technical team members to ensure alignment and information flow.
• Documentation & Process Improvement: Create, maintain, and regularly update clear documentation and reports covering methods, tools, test strategies, vulnerabilities, and impact assessments; continuously improve related processes to meet evolving needs.
• Knowledge Sharing: Provide guidance and occasional training to team members on recognising and responding to new bypass techniques.

Requirements:

• 6+ years of combined experience in web application testing, automation, and data analysis.
• Proven ability to develop and maintain automated tests (using Python or Java, Pytest, REST Assured, or similar), including integration with REST APIs.
• Experience with prompt engineering and LLM APIs.
• Understanding of the ML lifecycle (training, fine-tuning, eval), Generative AI, and related technologies.
• Capable of analysing complex datasets to identify patterns, trends, and anomalies related to AI detection bypass techniques.
• Experience with version control (Git) and CI/CD pipelines.
• Experience with API testing.
• Excellent written and verbal English for effective cross-team communication, including with non-technical stakeholders.
• Working knowledge of Excel or Google Sheets (including formulas).
• Experience leading or mentoring teams in test automation initiatives.

Nice to Have:

• Exposure to security testing or red-teaming, especially related to NLP or AI systems.

Total Rewards @ Turnitin
Turnitin maintains a Total Rewards package that is competitive within the local job market. People tend to think about their Total Rewards monetarily — solely as regular pay plus bonus or commission. This is what they earn in exchange for what they do. However, Turnitin delivers more than just these components. Beyond the intrinsic rewards of unleashing your potential to positively impact global education, and thriving in an organization that is free of politics and full of humble, inclusive and collaborative teammates, the extrinsic rewards at Turnitin include generous time off and health and wellness programs that offer choice and flexibility and provide a safety net for the challenges that life presents from time to time. Experience a remote-centric culture that empowers you to work with purpose and accountability in a way that best suits you, supported by a comprehensive package that prioritizes your overall well-being.

Our Mission is to ensure the integrity of global education and meaningfully improve learning outcomes.

Our Values underpin everything we do.

• Customer Centric - We realize our mission to ensure integrity and improve learning outcomes by putting educators and learners at the center of everything we do.
• Passion for Learning - We seek out teammates that are constantly learning and growing and build a workplace which enables them to do so.
• Integrity - We believe integrity is the heartbeat of Turnitin. It shapes our products, the way we treat each other, and how we work with our customers and vendors.
• Action & Ownership - We have a bias toward action and empower teammates to make decisions.
• One Team - We strive to break down silos, collaborate effectively, and celebrate each other’s successes.
• Global Mindset - We respect local cultures and embrace diversity. We think globally and act locally to maximize our impact on education.
• Remote First Culture
• Health Care Coverage*
• Education Reimbursement*
• Competitive Paid Time Off
• 4 Self-Care Days per year
• National Holidays*
• Charitable contribution match*
• Monthly Wellness or Home Office Reimbursement/*
• Access to Modern Health (mental health platform)
• Retirement Plan with match/contribution*

* varies by country

Seeing Beyond the Job Ad
At Turnitin, we recognize it’s unrealistic for candidates to fulfill 100% of the criteria in a job ad. We encourage you to apply if you meet the majority of the requirements because we know that skills evolve over time. If you’re willing to learn and evolve alongside us, join our team!

Turnitin, LLC is committed to the policy that all persons have equal access to its programs, facilities and employment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.