Sr. Test Engineer - Playwright Job

YASH Technologies; Pune District; On-site; INR 1,200,000 - 1,600,000; Full time

Job summary

YASH Technologies, Inc. is seeking a QA Engineer in Pune to own testing of enterprise web apps built on React and FastAPI, including AI features. The role spans functional, API, automation, data, performance, and AI output-quality testing from planning to release sign-off.

Requirements include 4–6 years of experience with 2+ years in test automation, strong API testing, and CI/CD integration. Join our Hyperlearning workplace with flexible work and a collaborative culture.

Qualifications

• 3-5 years of QA experience on web applications, including at least 2 years of test automation.
• Strong API testing skills (REST, JSON, authentication flows) with pytest, Postman, or equivalent.
• Experience integrating tests into CI/CD pipelines (GitHub Actions, Jenkins, or TeamCity).

Responsibilities

• Analyze requirements and user stories; create test plans, scenarios, test cases, and traceability matrices.
• Perform functional, regression, and system integration testing (SIT), and support UAT for web applications.
• Build and maintain UI automation using Playwright, Cypress, or Selenium, and API automation using pytest, Postman, or REST Assured.
• Test FastAPI services for contract correctness, authentication and role‑based access, error handling, and data validation.
• Validate the accuracy of analytics outputs against source data using SQL.
• Test AI and agentic features for response accuracy, grounding, consistency, tool‑call correctness, guardrails, and prompt‑injection and safety scenarios; maintain golden datasets with AI engineers.
• Plan and run performance and load tests (JMeter, k6, or Locust) for APIs, streaming responses, and long‑running jobs.
• Integrate automated test suites into CI/CD pipelines.
• Log, triage, and track defects in Jira; publish release quality reports and support go/no‑go decisions.
• Produce validation‑ready test documentation for regulated (GxP) clients where required.

Skills

QA experience on web apps

Test automation

Playwright

Cypress

Selenium

API testing

CI/CD

Tools

Playwright

Cypress

Selenium

pytest

Postman

REST Assured

Job description

Select how often (in days) to receive an alert: Create Alert

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hirePlaywright Professionals in the following areas :

Experience required: 4-6 years

We are looking for a QA Engineer to own the quality of enterprise web applications built on React and FastAPI that include agentic AI features. The role covers functional, API, automation, data, performance, and AI output-quality testing, from test planning through SIT, UAT support, and release sign-off.

Key Responsibilities

• Analyze requirements and user stories; create test plans, scenarios, test cases, and traceability matrices.
• Perform functional, regression, and system integration testing (SIT), and support UAT for web applications.
• Build and maintain UI automation using Playwright, Cypress, or Selenium, and API automation using pytest, Postman, or REST Assured.
• Test FastAPI services for contract correctness, authentication and role‑based access, error handling, and data validation.
• Validate the accuracy of analytics outputs against source data using SQL.
• Test AI and agentic features for response accuracy, grounding, consistency, tool‑call correctness, guardrails, and prompt‑injection and safety scenarios; maintain golden datasets with AI engineers.
• Plan and run performance and load tests (JMeter, k6, or Locust) for APIs, streaming responses, and long‑running jobs.
• Integrate automated test suites into CI/CD pipelines.
• Log, triage, and track defects in Jira; publish release quality reports and support go/no‑go decisions.
• Produce validation‑ready test documentation for regulated (GxP) clients where required.

Required Skills and Qualifications

• 3-5 years of QA experience on web applications, including at least 2 years of test automation.
• Strong API testing skills (REST, JSON, authentication flows) with pytest, Postman, or equivalent.
• Experience integrating tests into CI/CD pipelines (GitHub Actions, Jenkins, or TeamCity).
• Solid grasp of test design techniques, defect lifecycle, and Agile delivery.
• Experience with Jira and a test management tool such as TestRail, Zephyr, or Xray.

Preferred Skills

• Experience testing LLM or agentic applications.
• LLM evaluation tools such as DeepEval, Ragas, promptfoo, or Langfuse.
• Performance testing experience with JMeter, k6, or Locust.
• Basic security testing knowledge (OWASP Top 10, including LLM‑specific risks).
• Pharma, life sciences, or GxP computer system validation experience.
• ISTQB or equivalent certification.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career‑oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self‑determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture