Artificial Intelligence Test Engineer

Avensys Consulting UK; Cambridge; On-site; GBP 65,000 - 85,000; Full time

Job summary

A specialized consulting firm is seeking a Senior Recruitment Specialist to validate cloud-native AI services and implement automated testing strategies. Candidates should have over 12 years of software testing experience, strong skills in API testing, and a commitment to ethical AI practices. This role is ideal for professionals with a builder mindset who thrive in an Agile environment.

Qualifications

• 12+ years of experience in software testing, QA, or validation roles.
• Proficient in designing automated testing frameworks.
• Experience working in Agile teams and global collaboration.

Responsibilities

• Validate distributed, cloud-native services and public APIs.
• Design validation strategies and automated testing frameworks.
• Ensure compliance with AI regulations and ethical standards.

Skills

LLM evaluation techniques

Prompt engineering

AI safety awareness

Software testing

API testing

Mentoring

Tools

Azure DevOps

CI/CD pipelines

Microsoft technologies

Job description

Overview

Senior Recruitment Specialist at Avensys Consulting specializing in talent acquisition.

Responsibilities

• We are looking for a detail-oriented and forward-thinking Test Engineer to ensure the quality, performance, and security of our Core AI Services. You will help validate distributed, cloud-native services and public APIs that form the foundation for enterprise AI capabilities.
• You’ll be part of a Scrum team and work closely with developers and architects to design effective validation strategies, automated testing frameworks, and AI-specific evaluation tools, with a builder mindset, rapid prototyping and continuous improvement, and agility of a start-up.

Core Skills and Qualifications

• Familiarity with LLM evaluation techniques, output scoring, and validation frameworks.
• Understanding of prompt engineering, RAG, model orchestration, and hallucination detection.
• Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations.
• Defining performance metrics for AI services and testing for the same.
• Awareness of AI safety, bias detection, and explainability techniques.
• Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act).
• Strong belief in ethical AI practices, transparency, and end-user trust.
• 12+ years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies.
• Proficient in designing automated testing frameworks.
• Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized architectures.
• Strong understanding of API testing, performance profiling, and security testing (including OWASP Top 10).
• Excellent problem-solving skills with the ability to analyze complex technical challenges and propose scalable solutions.
• Experience working in Agile teams and collaborating across global R&D locations.
• Demonstrated ability to mentor junior team members and foster a culture of continuous learning and innovation.

Seniority level

• Mid-Senior level

Employment type

• Contract

Job function

• Information Technology

Industries

• IT Services and IT Consulting

Referrals increase your chances of interviewing at Avensys Consulting UK.