AI (artificial intelligence) Test Automation Engineer

Huxley; City Of London; Hybrid; GBP 70,000 - 85,000; Full time

Job summary

A leading STEM business in the United Kingdom is seeking an AI Test Automation Engineer to develop automated testing frameworks for their AI agents. This permanent role offers a competitive salary between £70,000 and £85,000, with a flexible hybrid working model based in London or Glasgow. You will play a critical role in ensuring the reliability and robustness of AI solutions, while collaborating with a relaxed and high-functioning team focused on digital transformation.

Qualifications

• Expertise in test automation frameworks is essential.
• Experience with LLM behaviour testing, including misuse and injection detection.
• Knowledge in CI/CD integration using Azure DevOps.

Responsibilities

• Design and implement automated testing frameworks for AI agents.
• Ensure safety, reliability, and robustness of AI solutions.
• Contribute to digital transformation within a high-functioning team.

Skills

LLM behaviour testing

CI/CD integration with Azure DevOps

Python/YAML scripting

Tools

PyTest

Postman

Playwright

k6

Job description

AI (artificial intelligence) Test Automation Engineer

Brilliant new opportunity for an AI Test Automation Engineer with expertise in test automation frameworks to join a thriving STEM business that is heavily investigating its AI (artificial intelligence) platform, including building a best-in-class AI platform with a custom build of everything.

• Title: AI (artificial intelligence) AI Test Automation Engineer
• Location: can be based in either Glasgow or London City, 1 or 2 days a week in the office and home working hybrid
• Permanent role – salary £70,000–85,000
• Technical stack: Test automation frameworks (e.g., PyTest, Postman, Playwright, k6)

About the job

As the AI Test Automation Engineer, you will design and implement automated testing frameworks to validate the safety, reliability, and robustness of AI agents across our orchestration platform. This is an opportunity to join a high-functioning relaxed team that will significantly contribute to digital transformation.

Skills, Knowledge & Experience

• LLM behaviour testing, including misuse and injection detection
• CI/CD integration with Azure DevOps for continuous testing
• Python/YAML scripting for scenario and agent validation

Remote Working

• Expected to be in the office 1 to 2 days a week. With additional days depending on activity (e.g. a design workshop)

For more information, and the chance to be considered, please do send through a CV.

To find out more about Huxley, please visit www.huxley.com

Huxley, a trading division of SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC387148 England and Wales