Responsible AI Testing Lead

Yorkshire Building Society; Leeds; Hybrid; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Holiday

Bonus

Pension

Healthcare

My Benefits

Job summary

Yorkshire Building Society is seeking an AI Test Lead to define and lead testing for AI-enabled systems in a regulated financial services environment, ensuring robust QA across AI solutions. This hybrid role combines home working with on-site presence in Bradford and Leeds, offering flexible hours and a supportive environment for responsible AI testing.

You will work with Azure AI services, Copilot-based solutions and DevOps/MLOps pipelines to embed test automation and governance across delivery

Qualifications

• Experience in testing AI systems and QA for complex, regulated environments.
• Knowledge of AI/ML tech including LLMs and RAG.
• Experience with test automation and CI/CD in DevOps/MLOps.
• Experience with Azure AI services and Copilot-based solutions.

Responsibilities

• Develop AI testing frameworks that handle non-deterministic outputs.
• Embed responsible AI and risk testing for bias and safety.
• Implement automated AI testing and integrate into DevOps/MLOps.
• Collaborate with delivery and governance teams to align with standards.

Skills

QA for complex systems

AI/ML knowledge

RAG knowledge

DevOps pipelines

MLOps practices

Azure

Stakeholder communication

Tools

Azure AI services

Copilot-based solutions

Test automation

CI/CD pipelines

Job description

Yorkshire Building Society is seeking an AI Test Lead to define and lead testing for AI-enabled systems in a regulated financial services environment, ensuring robust QA across AI solutions. This hybrid role combines home working with on-site presence in Bradford and Leeds, offering flexible hours and a supportive environment for responsible AI testing.

You will work with Azure AI services, Copilot-based solutions and DevOps/MLOps pipelines to embed test automation and governance across delivery