Test Automation Engineer( Azure AI , Playwright ,Python/Javascript)

Cognizant; Greater London; On-site; GBP 70,000 - 110,000; Full time

Job summary

Cognizant in the United Kingdom is seeking a hands-on Test Automation Engineer to shape and scale end-to-end automation across UI, API, and performance testing in our AI-focused projects.

You will design scalable test frameworks, implement with Playwright and Azure DevOps, and collaborate with cross-functional teams to ensure reliable software quality, security, and accessibility compliance.

Experience in GenAI testing, RAG evaluation and responsible AI validation is a plus.

Qualifications

• Strong hands‑on experience with Playwright automation.
• Proven experience designing, enhancing, and maintaining scalable test automation frameworks.
• Strong experience in UI, API, functional, regression, integration, and end-to-end automation testing.
• Experience with REST API automation and tools such as Postman or equivalent.
• Strong working knowledge of Azure DevOps, Git, CI/CD pipelines, automated test execution, and reporting.
• Good understanding of automation design patterns, reusable components, test-data management, and reliable locator strategies.
• Experience analysing test failures and debugging automation code and application issues.
• Good understanding of Agile/Scrum delivery and quality engineering practices.
• Strong analytical, problem-solving, communication, and stakeholder-management skills.
• Experience with performance testing tools such as K6, Locust, JMeter, or Azure Load Testing.
• Experience with AI/GenAI solution testing, including RAG evaluation, golden datasets, hallucination detection, prompt-injection testing, bias/fairness assessment, or responsible AI validation
• Knowledge of accessibility automation and WCAG standards.
• Exposure to security testing and authentication mechanisms such as OAuth/OIDC/SSO.
• Familiarity with AI-assisted engineering tools such as GitHub Copilot for accelerating test design and automation development.

Responsibilities

• K6/Locust Performance Testing, Load/Stress Testing, Scalability Validation, Performance Analysis, and Azure Monitoring.
• Azure AI Foundry Evaluation, Golden Dataset Validation, RAG Testing, Hallucination Detection, and AI Output Quality Assurance.
• Azure AI Foundry Red Teaming, Prompt Injection Testing, Bias & Fairness Assessment, Toxicity Testing, and Responsible AI Validation.
• Azure DevOps, CI/CD Automation, Accessibility Testing (WCAG 2.2 AA), Security Testing, and Test Reporting & Governance.

Skills

Playwright

Automation frameworks

UI automation

API automation

REST API

Azure DevOps

CI/CD pipelines

Test reporting

Agile/Scrum

GenAI testing

RAG evaluation

Hallucination detection

Accessibility testing

Security testing

AI-assisted tooling

Tools

Postman

Locust

K6

JMeter

Azure Load Testing

Git

Job description

Key Responsibilities

• K6/Locust Performance Testing, Load/Stress Testing, Scalability Validation, Performance Analysis, and Azure Monitoring.


• Azure AI Foundry Evaluation, Golden Dataset Validation, RAG Testing, Hallucination Detection, and AI Output Quality Assurance.


• Azure AI Foundry Red Teaming, Prompt Injection Testing, Bias & Fairness Assessment, Toxicity Testing, and Responsible AI Validation.


• Azure DevOps, CI/CD Automation, Accessibility Testing (WCAG 2.2 AA), Security Testing, and Test Reporting & Governance.

Required Skills & Experience

• Strong hands‑on experience with Playwright automation.


• Proven experience designing, enhancing, and maintaining scalable test automation frameworks.


• Strong experience in UI, API, functional, regression, integration, and end-to-end automation testing.


• Experience with REST API automation and tools such as Postman or equivalent.


• Strong working knowledge of Azure DevOps, Git, CI/CD pipelines, automated test execution, and reporting.


• Good understanding of automation design patterns, reusable components, test-data management, and reliable locator strategies.


• Experience analysing test failures and debugging automation code and application issues.


• Good understanding of Agile/Scrum delivery and quality engineering practices.


• Strong analytical, problem-solving, communication, and stakeholder-management skills.


• Experience with performance testing tools such as K6, Locust, JMeter, or Azure Load Testing.


• Experience with AI/GenAI solution testing, including RAG evaluation, golden datasets, hallucination detection, prompt-injection testing, bias/fairness assessment, or responsible AI validation.


• Knowledge of accessibility automation and WCAG standards.


• Exposure to security testing and authentication mechanisms such as OAuth/OIDC/SSO.


• Familiarity with AI-assisted engineering tools such as GitHub Copilot for accelerating test design and automation development.