QA Tester - AI

Dicetek LLC; Abu Dhabi; On-site; AED 300,000 - 420,000; Full time

Job summary

Dicetek LLC is seeking a Senior Quality Automation Engineer to lead UI and API automation, AI-driven validation, and backend testing across distributed systems. You will shape test strategies, implement scalable Playwright-based frameworks, and collaborate with cross-functional teams to ensure high-quality releases.

Responsibilities include validating asynchronous workflows with Kafka, executing contract tests, and evaluating GenAI features with LangSmith, Ragas, or TruLens, while promoting

Qualifications

• 5+ years of experience in QA Automation or Software Testing.
• Strong hands-on experience with Playwright.
• Experience testing APIs, microservices, and event-driven systems.
• Good understanding of Kafka, contract testing, and schema validation.
• Exposure to AI/LLM testing and RAG-based applications.
• Proficiency in TypeScript, JavaScript, or Python.
• Experience with CI/CD pipelines, Docker, and Kubernetes is a plus.

Responsibilities

• Build and maintain scalable UI and API automation frameworks using Playwright.
• Integrate automated tests into CI/CD pipelines.
• Improve execution speed, reliability, and reduce flaky tests.
• Validate asynchronous workflows and distributed systems using Kafka or similar messaging platforms.
• Implement contract testing and schema validation to ensure reliable communication between microservices.
• Verify event publishing, consumption, and end-to-end data integrity.
• Test and evaluate GenAI/LLM-based features for accuracy, relevance, and hallucination handling.
• Work with evaluation frameworks such as Ragas, LangSmith, or TruLens.
• Build and maintain datasets for regression and prompt validation.
• Collaborate with developers, AI engineers, and product teams to define quality strategies.
• Participate in architecture, API, and prompt design discussions.

Skills

Playwright

API testing

Kafka

Contract testing

Schema validation

AI/LLM testing

RAG apps

CI/CD

Docker

Kubernetes

TypeScript

JavaScript

Python

QA automation

Tools

LangSmith

Ragas

TruLens

Job description

About The Role

We are looking for a Senior Quality Automation Engineer with strong experience in modern test automation, backend validation, and AI-driven application testing.

Senior Quality Automation Engineer

(UI & API & AI Validation)

About The Role

We are looking for a Senior Quality Automation Engineer with strong experience in modern test automation, backend validation, and AI-driven application testing.

You will work across UI/API automation, event-driven microservices, and GenAI evaluation workflows to ensure high-quality releases across distributed systems.

Key Responsibilities

Automation Engineering

• Build and maintain scalable UI and API automation frameworks using Playwright (TypeScript/JavaScript or Python).
• Integrate automated tests into CI/CD pipelines.
• Improve execution speed, reliability, and reduce flaky tests.

Backend & Event-Driven Testing

• Validate asynchronous workflows and distributed systems using Kafka or similar messaging platforms.
• Implement contract testing and schema validation to ensure reliable communication between microservices.
• Verify event publishing, consumption, and end-to-end data integrity.

AI & LLM Validation

• Test and evaluate GenAI/LLM-based features for accuracy, relevance, and hallucination handling.
• Work with evaluation frameworks such as Ragas, LangSmith, or TruLens.
• Build and maintain datasets for regression and prompt validation.

Collaboration

• Work closely with developers, AI engineers, and product teams to define quality strategies.
• Participate in architecture, API, and prompt design discussions.

Required Skills

• 5+ years of experience in QA Automation or Software Testing.
• Strong hands-on experience with Playwright.
• Experience testing APIs, microservices, and event-driven systems.
• Good understanding of Kafka, contract testing, and schema validation.
• Exposure to AI/LLM testing and RAG-based applications.
• Proficiency in TypeScript, JavaScript, or Python.
• Experience with CI/CD pipelines, Docker, and Kubernetes is a plus.