Qa Test Engineer

PwC India; Gurugram District; Híbrido; INR 800.000 - 1.600.000; Jornada completa

Descripción de la vacante

Price Waterhouse Cooper LLP in Gurgaon, India, seeks a QA Automation Engineer to own fully automated testing of AI products. This automation-only role has no manual testing; all functional, API, regression and LLM output tests run automatically in the CI/CD pipeline and act as quality gates before every release.

You will design the test strategy, build UI/API/end-to-end suites with Playwright/Selenium, and integrate tests into Azure DevOps or GitHub Actions, working with AI/ML and DevOps for

Formación

• Experience with automated testing using Playwright or Selenium.
• Proficient in Python-based API testing (PyTest, requests).
• CI/CD integration of tests in Azure DevOps or GitHub Actions.

Responsabilidades

• Design and own test automation strategy and framework for AI products.
• Build automated UI, API and end-to-end test suites.
• Automate LLM and GenAI output evaluation (accuracy, relevance, safety).
• Integrate test suites into CI/CD pipelines as release gates.
• Create automated regression, smoke and performance tests and manage test data.

Conocimientos

Playwright

Selenium

Python

PyTest

CI/CD

LLM evaluation testing

Git

Educación

Engineering degree (B.E./B.Tech./M.E./M.Tech./MCA in IT/Data Science or related)

ISTQB certification (optional)

Herramientas

Azure DevOps

GitHub Actions

Allure

Descripción del empleo

Job Summary

We are looking for a QA Automation Engineer to own fully automated testing of our AI products. This is an automation-only role with no manual testing. All functional, API, regression and LLM output tests must run automatically in the CI/CD pipeline and act as quality gates before every release.

Key Responsibilities

• Design and own the test automation strategy and framework for AI products.
• Build automated UI, API and end-to-end test suites using Playwright/Selenium and PyTest.
• Automate LLM and GenAI output evaluation, covering accuracy, relevance, hallucination, safety and prompt regression.
• Integrate all test suites into CI/CD pipelines (Azure DevOps/GitHub Actions) as release quality gates.
• Build automated regression, smoke and performance tests, including test data management.
• Track and report test coverage, pass rates and defect trends through dashboards.
• Work with AI/ML and DevOps engineers on shift-left testing and fast feedback loops.

Required Skills

• Strong test automation with Playwright and/or Selenium.
• Python with PyTest; API test automation (REST Assured, Postman/Newman or Python requests).
• CI/CD integration of tests in Azure DevOps or GitHub Actions.
• LLM evaluation testing using tools such as DeepEval, Ragas, promptfoo or similar.
• Git, test reporting (Allure or similar) and Agile/Scrum practices.
• Clear understanding of test design, coverage and defect lifecycle.

Preferred Skills

• Performance testing (JMeter, Locust or k6).
• Security test basics (OWASP ZAP) and accessibility testing.
• Testing in Docker/Kubernetes environments.
• ISTQB Advanced Test Automation Engineer certification.

Educational Qualification

B.E. / B.Tech. / M.E. / M.Tech. / MCA , IT, AI, Data Science or a related discipline. ISTQB or an equivalent test automation certification is a plus.