Senior Playwright Automation Engineer

GSPANN Technologies, Inc.

Hyderabad

On-site

INR 420,000 - 620,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

GSPANN Technologies, Inc. is seeking a Senior Playwright Automation Engineer to design scalable test automation frameworks and validate Generative AI and Agentic AI applications.

You will focus on advanced testing strategies for AI systems and ensure robust automation across UI, API, and integration layers. You will build reusable components using Page Object Model patterns, implement CI/CD integration, and contribute to evaluation metrics for AI quality, latency, and reliability.

Qualifications

  • 8+ years in Software QA and test automation.
  • Experience designing, developing, and maintaining scalable automation frameworks using POM and reusable components.
  • Strong REST API and microservices testing experience.
  • Hands-on Playwright automation and CI/CD integration.
  • Experience testing Gen AI apps (LLMs, chatbots, agents).
  • Knowledge of Prompt Engineering, LLM evaluation, RAG, AI safety, and guardrail testing.
  • Experience validating Agentic AI systems with multi-agent workflows.

Responsibilities

  • Automate UI, API, integration, regression, smoke, and end-to-end tests.
  • Build reusable frameworks using Page Object Model and fixtures.
  • Perform API automation testing for REST and microservices.
  • Integrate automated tests into CI/CD pipelines.
  • Validate Generative AI-powered applications including LLMs and agents.
  • Design test strategies for prompt validation, response accuracy, and safety testing.
  • Develop automated validation frameworks for AI outputs.
  • Test Agentic AI workflows involving multi-agent orchestration and planning.
  • Validate AI integrations with enterprise apps, APIs, databases, and third-party services.
  • Create evaluation metrics for AI quality, latency, and reliability.
  • Implement automated testing for AI workflows using Playwright, APIs, and AI evaluation frameworks.

Skills

UI testing
API testing
End-to-end testing
CI/CD integration
Playwright
REST API testing
AI testing
Prompt engineering

Tools

Jenkins
Azure DevOps
GitHub Actions
GitLab CI
Git

Job description

Description

GSPANN is hiring a Senior Playwright Automation Engineer to design scalable test automation frameworks and validate Generative AI and Agentic AI applications, focusing on advanced testing strategies for AI systems.

Roles and Responsibilities
  • Automate UI, API, integration, regression, smoke, and end-to-end testing scenarios.
  • Build reusable frameworks leveraging Page Object Model (POM), fixtures, and custom utilities.
  • Perform API automation testing for Representational State Transfer (REST) and microservices-based applications.
  • Integrate automated test execution into Continuous Integration / Continuous Delivery (CI/CD) pipelines.
  • Validate Generative AI-powered applications including Large Language Models (LLMs), chatbots, copilots, AI agents, and Retrieval Augmented Generation (RAG)-based systems.
  • Design test strategies for prompt validation, response accuracy, hallucination detection, toxicity, bias, guardrails, and safety testing.
  • Develop automated validation frameworks for AI-generated outputs.
  • Test Agentic AI workflows involving multi-agent orchestration, planning, tool usage, and autonomous decision-making.
  • Validate AI integrations with enterprise applications, APIs, databases, and third-party services.
  • Create evaluation metrics for AI quality, relevance, consistency, latency, and reliability.
  • Implement automated testing for AI workflows using Playwright, APIs, and AI evaluation frameworks.
Skills and Experience
  • Bring 8+ years of experience in Software Quality Assurance, Test Automation, and Quality Engineering.
  • Apply proven expertise in UI, API, integration, regression, smoke, and end-to-end test automation.
  • Work with experience designing, developing, and maintaining scalable automation frameworks from scratch using industry-standard design patterns such as Page Object Model (POM) and reusable test components.
  • Develop strong experience in Representational State Transfer (REST) API testing, microservices testing, and API automation using Playwright and related tools.
  • Manage hands-on experience integrating automated test suites with Continuous Integration / Continuous Delivery (CI/CD) pipelines using Jenkins, Microsoft Azure DevOps, GitHub Actions, or GitLab CI.
  • Utilize practical experience with source control systems such as Git and Agile and Scrum delivery methodologies.
  • Bring experience testing Generative Artificial Intelligence (Gen AI) applications, including Large Language Model (LLM)-based chatbots, AI assistants, copilots, and conversational AI platforms.
  • Demonstrate strong understanding of Prompt Engineering, Large Language Model (LLM) evaluation, Retrieval Augmented Generation (RAG), AI response validation, hallucination detection, AI safety, responsible AI, and guardrail testing.
  • Apply experience validating Agentic AI systems, including multi-agent workflows, autonomous decision-making, planning, tool orchestration, and agent-to-agent interactions.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Playwright Automation Architect
AI Playwright Automation Architect

GSPANN Technologies, Inc. • Hyderabad

On-site
INR 5,000,000 - 8,000,000
Health insurance
Senior Automation QA Engineer (AI & Playwright Focus)
Senior Automation QA Engineer (AI & Playwright Focus)

DIMAAG • Bengaluru Urban

On-site
INR 1,200,000 - 1,800,000
Lead Javascript Automation Test Engineer with AI & Agentic Testing
Lead Javascript Automation Test Engineer with AI & Agentic Testing

EPAM Systems Inc • Maharashtra

On-site
INR 4,000,000 - 7,000,000
Senior Software Test Automation Engineer
Senior Software Test Automation Engineer

Medknow Publications • Pune District

On-site
INR 2,400,000 - 3,600,000
Sr Automation Eng – TypeScript, Playwright & AI
Sr Automation Eng – TypeScript, Playwright & AI

GBIT (Global Bridge InfoTech Inc) • Hyderabad

On-site
INR 900,000 - 1,500,000
Senior JavaScript Automation Test Engineer with AI & Agentic Testing
Senior JavaScript Automation Test Engineer with AI & Agentic Testing

EPAM Systems Inc • Maharashtra

On-site
INR 2,400,000 - 4,000,000
Ai Automation Cgi Chennai Bengaluru
Ai Automation Cgi Chennai Bengaluru

vibehackers • Chennai District

On-site
INR 1,200,000 - 2,400,000
Software Development Engineer in Test
Software Development Engineer in Test

Brownbox consulting • Maharashtra

On-site
INR 800,000 - 1,200,000
Lead AI Test Engineer
Lead AI Test Engineer

Qentelli LLC • Hyderabad

On-site
INR 1,800,000 - 2,400,000
Ai Automation Test Engineer Playwright Web Mobile It Seals India Pvt Ltd Bengaluru
Ai Automation Test Engineer Playwright Web Mobile It Seals India Pvt Ltd Bengaluru

Vibehackers • Bengaluru

On-site
INR 1,800,000 - 3,000,000