AI Quality & Control Specialist

Yorkshire Building Society; Leeds; On-site; GBP 50,000 - 70,000; Full time

Job summary

A member-focused financial institution in Leeds is seeking an AI Quality & Control Specialist to lead the development of AI quality assurance frameworks. You'll ensure that AI initiatives are transparent, robust, and aligned with ethical standards. Responsibilities include establishing governance for AI, engaging with external standards, and working closely with cross-functional teams. Ideal candidates will have experience in AI model development, quality assurance frameworks, and excellent communication skills.

Benefits

25 days holiday plus bank holidays

Performance-based bonus up to 15%

Pension contribution up to 11%

Healthcare benefits including private medical insurance

Self-service benefits portal for discounts

Qualifications

• Experience in Data or Computer Science with a focus on AI.
• Proven experience in AI model validation and lifecycle management.
• Ability to translate policy into technical guidance.

Responsibilities

• Develop explainability protocols for AI systems.
• Collaborate with data teams to integrate quality controls.
• Establish governance checkpoints for AI initiatives.

Skills

AI model development

Quality assurance frameworks for AI

Data governance

Performance metrics

Agile methodologies

Communication skills

Tools

ISO 42001

NIST AI RMF

MLOps practices

Job description

We are thrilled to announce an incredible opportunity for an AI Quality & Control Specialist to join our team in AI & Data. In this exciting brand-new role, you ll lead the development and implementation of AI quality assurance and control frameworks across YBS, ensuring that AI-powered initiatives are explainable, robust and risk-aware by design. You will embed quality controls into business use cases, from projects through to BAU, and ensure all AI systems meet ethical, technical and regulatory expectations. As an AI Quality & Control Specialist, you will design and implement AI quality assurance frameworks that uphold responsible AI principles and regulatory standards, with a key focus on addressing current and emerging AI risks including fairness, bias mitigation, and social impact.

Responsibilities

• Lead the development of explainability protocols to ensure AI systems are transparent and auditable across their lifecycle, as well as implement and maintain quality risk and controls.
• Collaborate with data product and platform teams, data science, and transformation teams to ensure quality and control requirements are integrated into delivery pipelines.
• Establish governance checkpoints for AI initiatives, including pre-deployment reviews, post-implementation audits, and continuous monitoring.
• Support the AI Policy & Risk Specialist by translating policy into actionable quality controls and technical implementation guidance, also working with AI Council members to interlock quality checks, such as model risk, consumer duty.
• Provide expert guidance on use case documentation and traceability, ensuring alignment with internal governance and external regulatory expectations.
• Engage with external bodies and industry forums to benchmark YBS s AI quality practices and incorporate emerging standards, and champion a culture of quality and accountability in AI development.

Qualifications

• Are you passionate about making a difference, using your skills & experience to be a key enabler of AI-driven transformation? If so, we may have the role for you! You ll have experience in Data or Computer Science, with proven experience in AI model development, validation, and lifecycle management, with a strong understanding of performance metrics.
• Experience in designing and implementing quality assurance frameworks for AI systems.
• Familiarity with data and AI governance, ethics, and risk management.
• Knowledge of global AI standards and technical governance frameworks (ISO 42001, NIST AI RMF). And familiarity with MLOps practice.
• Proven experience embedding quality controls in transformation programmes and delivery pipelines, with the ability to translate policy and ethical principles into technical implementation guidance.
• A track record of working in agile, cross-functional teams with data scientists, engineers, and business stakeholders.
• Ability to translate complex information into clear business outcomes, with excellent verbal and written communication.

About YBS

At YBS we don t have shareholders, we have members. We care about people and that includes you. So here, you ll be respected for who you are, you ll be able to bring your whole self to work, and you ll have everything you need to build a long and rewarding career.

We offer a range of flexible working options without unsocial hours, enabling a healthy work‑life balance. From day one we’ll provide a brilliant induction and full training plan to get you up to speed quickly. We are passionate about creating an inclusive environment where everyone is welcome and able to be themselves.

Benefits

• Holiday: You ll get 25 days plus Bank Holidays, with the option to buy up to 5 additional days.
• Bonus: An on‑target bonus of 7% of eligible pay, with the opportunity to earn up to 15%.
• Pension: We contribute up to 11% into your YBS pension.
• Healthcare: Access to a range of health benefits including private medical insurance, dental, and other plans.
• My Benefits: A self‑service benefits portal for retail, hospitality, and health discounts.