AI Testing Engineering Lead

Barclays; London; On-site; GBP 70,000 - 100,000; Full time

Job summary

Join Barclays as an AI Testing Engineering Lead, where you'll lead a team in developing AI-powered solutions. This role involves spearheading testing strategies, collaborating with cross-functional teams, and driving innovation in a technology-driven environment. Ideal candidates will possess expertise in AI/ML evaluation and testing frameworks, ensuring high-quality software delivery.

Qualifications

• Experience in AI/ML system evaluation and validation.
• Proficiency in AI testing frameworks and automation.
• Understanding of the AI/ML/Gen AI ecosystem.

Responsibilities

• Design and execute testing strategies to validate functionality and performance.
• Develop and implement test plans and automated test scripts.
• Collaborate with teams to analyze requirements and support defect resolution.

Skills

AI/ML system evaluation and validation

AI testing frameworks and automation

Understanding of AI/ML/Gen AI ecosystem

Model Drift Analysis

Data Quality Assessment

Performance Testing for AI Systems

Stress Testing for AI Systems

AI Testing tools proficiency

Job description

Join us as an AI Testing Engineering Lead at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences.

About the Role

Are you ready to lead a team at the forefront of AI innovation? We're seeking a 'customer obsessed' and forward-thinking AI Testing Engineering Lead.

This role offers an opportunity to shape and guide our organization, developing the next generation of AI-powered conversational solutions that redefine operational and customer service standards.

Leadership and Collaboration

You'll channel visionary leadership, share knowledge, develop our team, and drive strategic initiatives in a vibrant, technology-driven environment. Collaboration with cross-functional teams to craft groundbreaking AI solutions and set new industry standards is essential. If you're excited by this challenge, we want to hear from you!

Key Experience and Skills

To be successful, you should have experience with:

• Expertise in AI/ML system evaluation and validation
• Proficiency in AI testing frameworks and automation
• Understanding of the AI/ML/Gen AI ecosystem

Additional valued skills include:

• Model Drift Analysis and Data Quality Assessment
• Performance and Stress Testing for AI Systems
• Proficiency with AI Testing tools like Botium, TensorFlow Model Analysis, etc.

Location

This role is based at our London/Knutsford campus.

Purpose of the Role

Design, develop, and execute testing strategies to validate functionality, performance, and user experience. Collaborate with cross-functional teams to identify and resolve defects, and continuously improve testing processes to ensure software quality and reliability.

Accountabilities

• Develop and implement comprehensive test plans and strategies.
• Create and execute automated test scripts using relevant frameworks and tools.
• Collaborate with teams to analyze requirements and contribute to acceptance criteria development.
• Perform root cause analysis and support defect resolution.
• Participate in code reviews and promote a culture of quality and knowledge sharing.
• Stay informed of industry trends and contribute to technology communities.

Leadership Expectations

• Advise stakeholders on impact and alignment of functional areas.
• Manage risks and support governance initiatives.
• Demonstrate leadership in risk management and controls.
• Understand organizational functions to support business goals.
• Build relationships with stakeholders and negotiate effectively.
• Apply analytical thinking to develop innovative solutions.
• Incorporate research outcomes into problem-solving.

All colleagues are expected to embody Barclays Values—Respect, Integrity, Service, Excellence, and Stewardship—and demonstrate the Barclays Mindset: Empower, Challenge, and Drive.