CT Engineering - Product Testing - Test Lead

Ernst & Young Advisory Services Sdn Bhd; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

EY in Bengaluru seeks a senior QA leader to drive AI/testing initiatives, define automation strategies, and advance enterprise-grade testing across UI, API, and AI components. The role requires strong leadership and agile execution in a fast-paced environment.

You will mentor a cross-functional team with data engineers and product groups, ensuring robust quality metrics, risk-based coverage, and timely delivery within an agile framework.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, IT, or related field with 12+ years of relevant experience.
• Ability to implement automation strategy and guide the team.
• Proficiency in testing concepts, standards, and Agile methodologies.
• Hands-on experience building large-scale automation frameworks across UI, API and back-end.
• Experience with Selenium with Java or Python.

Responsibilities

• Lead test activities to ensure product quality and set project timelines.
• Define and implement test strategies, standards, and risk-based coverage.
• Develop and maintain automation strategies across UI, API, and AI testing.
• Architect reusable automation frameworks and integrate with CI/CD pipelines.
• Drive defect triage and release readiness decisions.
• Mentor a cross-functional testing team across AI, data engineering, and product groups.

Skills

Testing lifecycle

Agile frameworks

Leadership

AI testing

Cross-cultural collaboration

Education

Bachelor’s degree in Computer Science or related field

Tools

Selenium (Java or Python)

Azure DevOps

CI/CD

Job description

Overview

At EY, we are all in to shape your future with confidence. We help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help build a better working world.

The Opportunity

Fuelled by a strategic investment in technology and innovation, Client Technology seeks to drive growth opportunities and solve complex business problems for our clients through building a robust platform for business and a powerful product engine integral to innovation at scale. You will work with technologists and business specialists, blending EY’s deep industry knowledge and innovative ideas with our platforms, capabilities, and technical expertise. As a champion for change and growth, you will be at the forefront of integrating emerging technologies from AI to data analytics into every corner of what we do at EY.

Your Key Responsibilities

• Lead the test activities to ensure product quality, set project timelines, and supervise the activities of other testers.
• Identify test scope and set up test environments, prepare test plans, identify relevant metrics, and track required effort.
• Manage the execution of tests, review reports, and interpret recommendations for product or design changes.
• Define and implement comprehensive test strategies, standards, and risk‑based coverage.
• Define and implement automation strategies across functional and AI testing domains, ensuring scalability and maintainability.
• Evaluate and adopt cutting‑edge automation tools and technologies, including AI‑assisted test generation and validation.
• Drive automation coverage goals, balancing risk‑based testing with efficiency improvements to reduce manual effort.
• Architect and maintain reusable automation frameworks for both traditional and AI‑driven applications, integrated with CI/CD pipelines.
• Design, develop, and maintain standard and ad‑hoc reports tailored to business needs.
• Implement automated reporting processes to reduce manual effort and improve timeliness.
• Drive defect triage, prioritization, and release readiness decisions.
• Develop relationships with other engineering groups to evaluate, recommend and implement testing procedures for products, systems, components or modifications.
• Implement AI testing strategies including DeepEval for model evaluation, ensuring robustness and reliability of outputs.
• Design and execute test plans for Retrieval‑Augmented Generation frameworks, validating retrieval and generation accuracy.
• Develop agentic validation workflows for multi‑agent systems, focusing on reasoning accuracy and orchestration.
• Conduct bias, fairness, and ethical compliance testing for AI models.
• Lead and mentor a cross‑functional testing team, fostering collaboration across AI, data engineering, and product development groups.
• Define strategic testing roadmaps for AI‑driven products and manage stakeholder communication on quality metrics and risks.

Skills and Attributes for Success

• Broad understanding of testing lifecycle and agile frameworks.
• Specialized knowledge of Quality Management techniques.
• Strong leadership and team management skills with experience in guiding diverse teams.
• Broad understanding of AI testing.
• Customer centricity, innovative thinking, agility, and intercultural sensitivity.

To Qualify for the Role You Must Have

• Bachelor’s degree in Computer Science, Engineering, IT, or a related field and 12+ years of relevant work experience.
• Ability to implement automation strategy and guide the team.
• Proficiency in testing concepts, standards, and Agile methodology.
• Strong understanding of Automation Testing concepts and ability to implement automation/performance strategy.
• Hands‑on experience authoring, building and adopting large‑scale automation frameworks across UI, functional, API and back‑end integration.
• Experience in Selenium with Java or Python scripting/coding.
• Excellent analytical and problem‑solving skills.
• Experience with Azure DevOps or any relevant defect management tool and CI/CD.
• Self‑starter, flexible to adjust to multiple demands, shifting priorities, ambiguity and rapid change.
• Excellent written and verbal communication skills.
• Ability to understand and integrate with cultural differences and engage with virtual cross‑cultural, cross‑border teams.
• Experience supporting small to medium size projects and the relevant performance indicators and metrics.