AI Testing Engineering Lead

Barclays UK; London; On-site; GBP 80,000 - 100,000; Full time

Job summary

Join a leading company as an AI Testing Engineering Lead, where you'll drive innovation in AI solutions and enhance customer experiences. Lead a team to develop next-generation conversational solutions, ensuring software quality and reliability through comprehensive testing strategies.

Qualifications

• Experience with AI/ML system evaluation and validation.
• Proficiency in AI testing frameworks and automation.

Responsibilities

• Develop and implement comprehensive test plans and strategies.
• Create and execute automated test scripts for defect detection.
• Collaborate with teams to analyze requirements and develop criteria.

Skills

AI/ML system evaluation

AI testing frameworks

AI/ML/Gen AI ecosystem

Tools

Botium

TensorFlow Model Analysis

Job description

Join us as an AI Testing Engineering Lead at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences.

Are you ready to lead a team at the forefront of AI innovation? We're seeking a 'customer-obsessed' and forward-thinking AI Testing Engineering Lead.

This role offers an opportunity to shape and guide our organization, including the development of next-generation AI-powered conversational solutions that redefine our operations and enhance service for millions of customers and clients.

You will channel visionary leadership, share your knowledge, develop our people, and drive our strategic agenda to foster a vibrant, innovative environment where creativity and technology thrive. Collaboration with cross-functional teams to craft groundbreaking AI solutions and set new standards is essential. If you're excited by this challenge, we want to hear from you!

To succeed as an AI Testing Engineering Lead, you should have experience with:

• Expertise in AI/ML system evaluation & validation
• Proficiency in AI testing frameworks & automation
• Good understanding of the AI/ML/Gen AI ecosystem

Additional valued skills include:

• Model Drift Analysis and Data quality assessment
• Experience with performance and stress testing for AI systems
• Proficiency in AI testing tools like Botium, TensorFlow Model Analysis, etc.

This role is based at our London/Knutsford campus.

Purpose of the role

Design, develop, and execute testing strategies to validate functionality, performance, and user experience. Collaborate with cross-functional teams to identify and resolve defects, and continuously improve testing processes and methodologies to ensure software quality and reliability.

Accountabilities

• Develop and implement comprehensive test plans and strategies to validate software functionality and ensure quality standards.
• Create and execute automated test scripts using testing frameworks and tools for early defect detection.
• Collaborate with teams to analyze requirements, participate in design discussions, and develop acceptance criteria.
• Perform root cause analysis for defects, working closely with developers for resolution.
• Participate in code reviews and promote a culture of quality and knowledge sharing.
• Stay informed of industry trends and contribute to organizational technology communities.
• Advise stakeholders on functional and cross-functional impacts and alignments.
• Manage and mitigate risks, supporting controls and governance.
• Demonstrate leadership in risk management and control strengthening.
• Contribute to business goals through a comprehensive understanding of organizational functions.
• Build relationships with stakeholders to achieve business objectives, using influencing skills.
• Develop solutions through analytical thinking and innovative problem solving.
• Incorporate research outcomes into problem-solving processes.

All colleagues are expected to embody the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, and demonstrate the Barclays Mindset of Empower, Challenge, and Drive.

About the company

From current accounts, mortgages, and insurance to loans, credit cards, and savings accounts—see how we can help you. Let’s move forward together.