AI Testing Engineering Lead

Barclays; London; On-site; GBP 80,000 - 120,000; Full time

Job summary

Join a leading financial institution as an AI Testing Engineering Lead, where you will spearhead the evolution of AI solutions. This role involves developing innovative testing strategies, collaborating with cross-functional teams, and ensuring software quality to enhance customer experiences.

Qualifications

• Experience in AI/ML system evaluation & validation.
• Proficiency in AI testing frameworks & automation.

Responsibilities

• Develop and implement comprehensive test plans and strategies.
• Create and execute automated test scripts for defect detection.
• Collaborate with teams to identify and resolve defects.

Skills

AI/ML system evaluation

AI testing frameworks

AI/ML/Gen AI ecosystems

Tools

Botium

TensorFlow Model Analysis

Job description

Join us as an AI Testing Engineering Lead at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences.

Are you ready to lead a team at the forefront of AI innovation? We're seeking a 'customer-obsessed' and forward-thinking AI Testing Engineering Lead.

This role offers a unique opportunity to shape and guide our organization. Imagine developing the next generation of AI-powered conversational solutions that redefine our operations and enhance service delivery to millions of customers and clients.

You will utilize your visionary leadership, share your expertise, develop our talent, and drive strategic initiatives to foster a vibrant, innovative environment where creativity and technology thrive. Collaboration with cross-functional teams to craft groundbreaking AI solutions and set new standards is also key. If you're excited by this challenge, we want to hear from you!

To succeed as an AI Testing Engineering Lead, you should have experience with:

• Expertise in AI/ML system evaluation & validation
• Proficiency in AI testing frameworks & automation
• Good understanding of AI/ML/Gen AI ecosystems

Additional valued skills include:

• Model Drift Analysis and Data quality assessment
• Experience with performance and stress testing for AI systems
• Proficiency in AI testing tools like Botium, TensorFlow Model Analysis, etc.

This role is based at our London/Knutsford campus.

Purpose of the role

Design, develop, and execute testing strategies to validate functionality, performance, and user experience. Collaborate with cross-functional teams to identify and resolve defects, and continuously improve testing processes to ensure software quality and reliability.

Accountabilities

• Develop and implement comprehensive test plans and strategies to validate software functionality and ensure quality standards.
• Create and execute automated test scripts using testing frameworks and tools for early defect detection.
• Work with requirements and design teams to understand software features and develop acceptance criteria.
• Perform root cause analysis for defects and support resolution efforts.
• Participate in code reviews and promote a culture of quality and knowledge sharing.
• Stay informed of industry trends and contribute to the organization's technical communities.

Vice President Expectations

• Advise stakeholders on functional and cross-functional impacts and alignment.
• Manage risks and support governance initiatives.
• Demonstrate leadership in risk management and controls.
• Understand organizational functions to support business goals.
• Collaborate across teams to align strategies and activities.
• Develop solutions through sophisticated analysis and innovative thinking.
• Build and maintain relationships with stakeholders to achieve key objectives.

All colleagues are expected to embody the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, and demonstrate the Barclays Mindset of Empower, Challenge, and Drive.