AI Testing Engineering Lead

Barclays; London; On-site; GBP 80,000 - 120,000; Full time

Job summary

Join a leading financial institution as an AI Testing Engineering Lead, where you'll drive the development of innovative AI solutions. Collaborate with cross-functional teams to enhance customer experiences and ensure software quality. This role offers the chance to shape the future of AI in banking.

Qualifications

• Expertise in evaluating and validating AI/ML systems.
• Proficiency in AI testing frameworks and automation.

Responsibilities

• Develop and implement comprehensive test plans and strategies.
• Create and execute automated test scripts using testing frameworks and tools.

Skills

AI/ML system evaluation

AI testing frameworks

Automation

Tools

Botium

TensorFlow Model Analysis

Job description

Join us as an AI Testing Engineering Lead at Barclays, where you'll lead the development of our digital landscape, driving innovation and excellence. You'll utilize cutting-edge technology to enhance our digital offerings, ensuring exceptional customer experiences.

Are you ready to lead at the forefront of AI innovation?

We are seeking a 'customer-obsessed' and forward-thinking AI Testing Engineering Lead. This role offers the opportunity to shape and guide our organization, including developing next-generation AI-powered conversational solutions that transform our operations and service delivery to millions of customers and clients.

In this role, you will demonstrate visionary leadership, share your expertise, develop our team, and drive strategic initiatives to foster a vibrant, innovative environment where technology and creativity thrive. You will collaborate with cross-functional teams to develop groundbreaking AI solutions and set new industry standards. If this excites you, we want to hear from you!

Key Experience and Skills

• Expertise in AI/ML system evaluation and validation
• Proficiency in AI testing frameworks and automation
• Understanding of the AI/ML/Gen AI ecosystem

Additional Valued Skills

• Model drift analysis and data quality assessment
• Experience with performance and stress testing of AI systems
• Proficiency with AI testing tools like Botium, TensorFlow Model Analysis, etc.

This role is based at our London/Knutsford campus.

Purpose of the Role

Design, develop, and execute testing strategies to validate functionality, performance, and user experience. Collaborate with teams to identify and resolve defects and continuously improve testing processes to ensure software quality and reliability.

Accountabilities

• Develop and implement comprehensive test plans and strategies
• Create and execute automated test scripts using testing frameworks and tools
• Collaborate with teams to analyze requirements and develop acceptance criteria
• Perform root cause analysis and support defect resolution
• Participate in code reviews and promote a culture of quality
• Stay updated on industry trends and contribute to technical communities

Vice President Expectations

• Advise stakeholders on impact and alignment
• Manage risks and support governance
• Demonstrate leadership in risk management and controls
• Understand organizational functions to support business goals
• Collaborate across departments to align strategies
• Develop innovative solutions through analytical thinking
• Build and maintain relationships with stakeholders

All colleagues are expected to embody the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, and to demonstrate the Barclays Mindset of Empower, Challenge, and Drive.