Product Testing Lead

Ernst & Young LLP ( EY India ); Bengaluru; On-site; INR 4,000,000 - 6,500,000; Full time

Job summary

EY is seeking a Senior Test Lead in Bengaluru to drive testing across AI-enabled products and traditional platforms. You will lead test planning, environment setup, and risk-based coverage while guiding a team of testers in a fast-paced, global technology setting.

You will define and implement automation strategies, adopt cutting-edge tools, and ensure CI/CD pipelines are integrated with testing. Strong leadership and deep AI testing experience are essential for success.

Qualifications

• Bachelor's degree in Computer Science, Engineering, IT, or related field.
• 12+ years of relevant work experience.
• Ability to implement automation strategy and guide the team.
• Experience using AI for predictive analytics and test generation.

Responsibilities

• Lead test activities and set project timelines.
• Supervise testers and ensure product quality.
• Define test strategies and risk-based coverage.
• Implement automation strategies across functional and AI testing.
• Drive automation tools adoption and CI/CD integration.
• Lead and mentor a cross-functional testing team.

Skills

Testing leadership

Quality management

AI testing

Cross-functional leadership

Education

Bachelor's degree in Computer Science/Engineering/IT

Tools

Azure DevOps

Job description

CT Engineering-Product Testing-Test Lead At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

Test Lead

The Opportunity Fuelled by strategic investment in technology and innovation, Client Technology seeks to drive growth opportunities and solve complex business problems for our clients through building a robust platform for business and powerful product engine that are integral to innovation at scale. You will work with technologists and business specialists, blending EY’s deep industry knowledge and innovative ideas with our platforms, capabilities, and technical expertise. As a champion for change and growth, you will be at the forefront of integrating emerging technologies from AI to Data Analytics into every corner of what we do at EY. That means more growth for you, exciting learning opportunities, career choices, and the chance to make a real impact.

Your Key Responsibilities

• Lead the test activities to ensure product quality, setting project timelines and supervising the activities of other testers.
• Drive the identification of the test scope and test environment set-up, prepare test plans, identify relevant metrics and keep track of required effort.
• Manage the execution of tests, review reports and interpret recommendations for product or design changes.
• Define and implement comprehensive test strategies, standards, and risk-based coverage.
• Define and implement automation strategies across functional and AI testing domains, ensuring scalability and maintainability.
• Evaluate and adopt cutting-edge automation tools and technologies, including AI-assisted test generation and validation
• Drive automation coverage goals, balancing risk-based testing with efficiency improvements to reduce manual effort.
• Architect and maintain reusable automation frameworks for both traditional and AI-driven applications, integrated with CI/CD pipelines.
• Define and implement automation strategies across functional and AI testing domains, ensuring scalability and maintainability.
• Design, develop, and maintain standard and ad-hoc reports tailored to business needs.
• Implement automated reporting processes to reduce manual effort and improve timeliness.
• Drive defect triage, prioritization, and release readiness decisions.
• Develop relationships with other engineering groups to evaluate, recommend and implement testing procedures for products, systems, components or modifications.
• Implement AI testing strategies including DeepEval for model evaluation, ensuring robustness and reliability of outputs.
• Design and execute test plans for RAG (Retrieval-Augmented Generation) frameworks , validating retrieval and generation accuracy.
• Develop agentic validation workflows for multi-agent systems, focusing on reasoning accuracy and orchestration.
• Conduct bias, fairness, and ethical compliance testing for AI models.
• Build reusable automation frameworks for AI testing integrated with CI/CD pipelines.
• Lead and mentor a cross-functional testing team , fostering collaboration across AI, data engineering, and product development groups.
• Define strategic testing roadmaps for AI-driven products and manage stakeholder communication on quality metrics and risks.

Skills and Attributes for Success

• Broad understanding of testing lifecycle and agile frameworks.
• Specialized knowledge of Quality Management techniques.
• Strong leadership and team management skills with experience in guiding diverse teams.
• Broad understanding of AI testing

To Qualify for the Role You Must Have

• Bachelor's degree in Computer Science, Engineering, IT, or related field and 12+ years of relevant work experience.
• Should be able to implement automation strategy and guide the team.
• Leverage AI for predictive analytics, intelligent test case generation, and defect detection.
• Proficiency in testing concepts/standards & Agile methodology.
• Good understanding of Automation Testing concepts and ability to implement automation/performance strategy.
• Other Strengths required are # Customer centricity, Innovative Thinking, Agility and Intercultural Sensitivity
• Hands-on experience authoring, building and adopting large-scale automation frameworks across UI, functional, API and back-end integration.
• Experience in Selenium with Java / Python - scripting/coding level.
• Excellent analytical and problem-solving skills.
• Experience and knowledge of Azure DevOps or any relevant defect management tool and CI/CD.
• Self-starter, with flexibility to adjust to multiple demands, shifting priorities, ambiguity and rapid change.
• Excellent written and verbal communication skills.
• Ability to understand and integrate with cultural differences and engage with virtual cross-cultural, cross-border teams.
• Experience in supporting small to medium size projects and the relevant Performance indicators and metrics.

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

Experience Level Senior Level