Senior Test Engineer (AI)

Ofgem; Cardiff, Glasgow, Greater London; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

Ofgem, the UK energy regulator, seeks a Senior Test Engineer for AI to lead testing strategies for AI and data-driven services. You will design and implement testing across AI models, data pipelines, and digital services, while embedding test-driven practices and promoting quality throughout delivery.

You will collaborate with engineers, data scientists and product teams to ensure quality from design to deployment, mentor colleagues, and champion new testing approaches, including AI-driven

Qualifications

• Extensive experience managing testing across complex AI and data platforms.
• Strong knowledge of automated testing frameworks and Microsoft-based tools.
• Familiarity with CI/CD, DevOps and cloud-based test integration.
• ISTQB Advanced certification or equivalent.

Responsibilities

• Lead design and execution of test strategies across AI, data and digital services.
• Design and implement testing approaches for AI systems, model validation and data quality.
• Embed TDD and BDD across delivery teams with early and continuous testing.
• Develop and maintain automated test frameworks; integrate testing into CI/CD pipelines.
• Identify risks from test results and provide actionable insights to stakeholders.
• Collaborate with engineers, data scientists and product teams to ensure quality from design to deployment.
• Lead defect management, analyse trends, and drive continuous improvement in testing practices.
• Champion new testing approaches, including AI-driven testing and predictive analytics.
• Coach and mentor team members on testing practices and governance standards.

Skills

Testing management

AI testing

CI/CD

Quality assurance

Education

ISTQB Advanced (or equivalent)

Tools

Azure Test Plan

Co-pilot Studio

Co-pilot Studio CLI

PowerShell tools

AI Foundry

AI Foundry Agent evaluation SDK

Job description

Successful candidates may be based in any of our office locations – Cardiff, Glasgow, or London. We especially welcome applicants from Cardiff and Glasgow. (20% hybrid, 1 day per week)

Job summary

Across government, the successful adoption of artificial intelligence depends not only on innovation, but on the ability to assure quality, reliability and ethical use at scale. As AI systems become embedded in critical services, robust testing and validation practices are essential to ensure that models perform as expected, outputs are trustworthy and risks are effectively managed. Ofgem plays a vital role in the UK’s energy system, protecting consumers and enabling a more secure, fair and sustainable energy future, and strong assurance of AI-enabled services is critical to delivering this mission.

Ofgem is on an ambitious transformation journey. Within the Digital, Data and Security Services (DDSS) directorate, we are building advanced data and AI capabilities to support innovation, improve efficiency and enhance decision-making. As part of this, we are embedding modern testing practices across digital, data and AI services, ensuring that quality is built into every stage of delivery.

As the Senior Test Engineer for AI, you will play a key role in ensuring the quality and reliability of AI and data-driven solutions. You will lead the design and implementation of testing strategies for complex systems, including AI models, data pipelines and digital services. You will work across multidisciplinary teams, embedding test-driven and behaviour-driven development practices and promoting a culture of quality and continuous improvement.

This is a senior, hands-on technical role requiring strong expertise in testing, automation and AI systems, alongside the ability to influence and mentor across delivery teams.

You will be responsible for:

• Leading the design and execution of test strategies across AI, data and digital services, ensuring alignment with organisational standards and delivery objectives.
• Designing and implementing testing approaches for AI systems, including model validation, data quality assurance and pipeline testing.
• Embedding quality practices such as TDD and BDD across delivery teams, ensuring early and continuous testing throughout the lifecycle.
• Developing and maintaining automated test frameworks and integrating testing into CI/CD pipelines.
• Identifying risks and issues from test results, providing clear insight and recommendations to stakeholders.
• Collaborating with engineers, data scientists and product teams to ensure quality is embedded from design through to deployment.
• Leading defect management processes, analysing trends and supporting continuous improvement in quality and testing practices.
• Championing new testing approaches and tools, including AI-driven testing and predictive analytics.
• Coaching and mentoring team members, contributing to capability development and knowledge sharing across the organisation.
• Ensuring compliance with accessibility, security and governance standards within testing practices.

We are looking for:

A technically strong and forward-thinking testing professional who can lead quality assurance for AI and data-driven systems. You will bring experience in modern testing practices, alongside an understanding of AI and data platforms.

You may come from a testing, QA, data or engineering background, but you will demonstrate:

• Extensive experience managing testing across complex systems, including AI and data platforms
• Strong knowledge of automated testing frameworks and tools within Microsoft-based environments
• A solid understanding of CI/CD, DevOps and cloud-based testing integration
• The ability to analyse risks, manage defects and drive continuous improvement in quality

An ISTQB Advanced certification (or equivalent) is expected (or willingness to obtain).

Experience working in agile delivery environments, and exposure to AI model validation or data pipeline testing, would be beneficial.

This is an opportunity to play a key role in ensuring that Ofgem’s AI and data-driven services are reliable, ethical and high quality. You will help embed robust assurance practices across the organisation, supporting innovation while maintaining trust and performance in critical systems.

Person specification

• Extensive expertise in managing quality across the AI solution development lifecycle in a Microsoft AI environment using testing platforms and tools, including Azure Test Plan, Co-pilot Studio, Co-pilot studio CLI and PowerShell tools, AI foundry and AI foundry Agent evaluation SDK (Lead Criteria)
• Strong understanding of AI CI/CD, DevOps and cloud-based test integration practices.

Holds or can obtain the following certifications or equivalent:

• ISTQB Certified (Advanced Level)
• Experience working within agile delivery environments.

Behaviours

We'll assess you against these behaviours during the selection process:

• Making Effective Decisions
• Communicating and Influencing
• Delivering at Pace

Technical skills

We'll assess you against these technical skills during the selection process:

• You will also be invited to complete a technical test. Full details will be included in the invitation to interview.