Manager | Automation Testing | Mumbai | Engineering | Quality Engineering

Deloitte & Touche GmbH Wirtschaftsprüfungsgesellschaft; Mumbai; On-site; INR 250,000 - 450,000; Full time

Job summary

Deloitte Touche Tohmatsu India LLP in Mumbai is seeking a Senior Quality Engineer to own the quality strategy, develop scalable automation frameworks, and ensure AI-powered applications meet accuracy and safety standards.

Lead end-to-end testing across UI, API, integration and E2E scopes; drive CI/CD integration and quality gates while mentoring junior QA engineers and collaborating with cross-functional teams.

Qualifications

• 9+ years of experience in Quality Engineering and Test Automation.
• Hands-on expertise in Playwright with Python.
• Experience building scalable automation frameworks using Python, Pytest and Behave.
• Experience testing AI, Generative AI or LLM-powered applications.
• Strong API testing experience with Playwright, Postman, Requests or REST-assured; CI/CD and Agile practices.

Responsibilities

• Own end-to-end test strategy, automation roadmap, quality gates, and release-readiness.
• Design and maintain automation frameworks using Playwright with Python and Behave.
• Automate UI, API, integration, regression, and end-to-end testing.
• Support UAT automation and maintain regression suites; Selenium when required.
• Validate AI/LLM systems for accuracy, relevance, safety and bias.
• Test prompt injection, edge cases, RAG workflows and AI agent integrations.
• Build LLM evaluation frameworks, scorecards and regression suites.
• Integrate automated tests into CI/CD pipelines and implement quality gates.
• Conduct basic performance testing (p50/p95, throughput, SLA).
• Debug issues via logs, traces, DB validation and backend monitoring.
• Define quality dashboards and ensure traceability and compliance.
• Mentor QA engineers and collaborate with cross-functional teams.

Skills

Playwright with Python

Python

Pytest

Behave

AI/LLM testing

API testing

BDD

Git

CI/CD

Agile delivery

Mentoring

Education

Bachelor's degree in CS/IT

Tools

Playwright

Postman

REST-assured

Job description

Select how often (in days) to receive an alert:

Job Title: Manager | Automation Testing | Mumbai | Engineering | Quality Engineering

Manager | Automation Testing | Mumbai | Engineering | Quality Engineering
• Job requisition ID : 112463
• Location: Mumbai
• Entity: Deloitte Touche Tohmatsu India LLP

The Team

Deloitte's Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate,actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.

We are looking for a Senior Quality Engineer with strong expertise in Playwright with Python, API automation, and AI/LLM testing. The role will own the quality strategy, develop scalable automation frameworks, and ensure the accuracy, safety, reliability, performance, and compliance of AI-powered applications.

• Own the end-to-end test strategy, automation roadmap, quality gates, and release-readiness criteria.
• Design and maintain automation frameworks using Playwright with Python and BDD using Behave.
• Automate UI, API, integration, regression, and end-to-end testing.
• Support UAT automation and maintain existing regression suites using Selenium, where required.
• Validate AI/LLM systems for accuracy, relevance, hallucination, bias, safety, context retention, and fallback handling.
• Test prompt injection, harmful prompts, edge cases, RAG workflows, and AI agent integrations.
• Build LLM evaluation frameworks, benchmark datasets, scorecards, and regression suites.
• Integrate automated tests into CI/CD pipelines and implement continuous quality gates.
• Conduct basic performance testing covering p50/p95 response times, throughput, load, and SLA compliance.
• Debug issues using logs, traces, database validation, and backend monitoring.
• Define quality dashboards and ensure traceability, auditability, and compliance.
• Mentor QA engineers and collaborate with Product, Engineering, Data Science, Security, DevOps, and business teams.

Required Skills

• 9+ years of experience in Quality Engineering and Test Automation.
• Strong hands-on expertise in Playwright with Python.
• Experience in building scalable automation frameworks using Python, Pytest, and Behave.
• Experience testing AI, Generative AI, or LLM-powered applications.
• Strong API testing experience using Playwright, Postman, Requests, or REST-assured equivalents.Experience with BDD, Git, CI/CD, and Agile delivery practices.
• Knowledge of AI evaluation, prompt testing, RAG validation, hallucination testing, and Responsible AI.
• Strong problem-solving, mentoring, communication, and stakeholder-management skills.

Education

Bachelor's degree in computer science, Information Technology, or related field.