Senior QA Engineer for AI & Conversational Systems

Parser Limited; Dubai; On-site; AED 300,000 - 420,000; Full time

Job summary

Parser Limited in Dubai is seeking a Senior QA Engineer to ensure quality across complex data flows and AI-driven products, with emphasis on conversational agents.

You will design and execute tests for data pipelines, APIs, and LLM-based chat systems, build automation in Python, and collaborate with ML/NLP teams to define robust evaluation criteria.

The role offers opportunities to advance QA practices, address safety concerns, and impact real-time validation in a fast-moving AI environment.

Qualifications

• 5 years of QA experience with data systems or AI applications.
• Strong analytical skills and attention to detail to spot data and agent behavior inconsistencies.
• Proficiency in Python and SQL for data validation and test automation.
• Experience with API testing (REST/GraphQL).
• Familiarity with chatbot frameworks and LLMs.
• Desirable: using Copilot or similar AI assistants in testing.

Responsibilities

• Design and execute QA tests for data pipelines, APIs, and conversational agents.
• Create generative AI test scenarios including chatbot interactions, intent recognition, and edge-case behavior.
• Develop LLM test designs including prompts, grounding validation, and non-deterministic assertions.
• Perform safety checks for hallucination, bias, toxicity, and PII leakage.
• Validate structured and unstructured data outputs for consistency and accuracy.
• Establish and drive real-time testing approaches including streaming data validation and API monitoring.
• Collaborate with ML and NLP teams to define evaluation metrics and criteria for agent performance.
• Integrate AI-driven tools into the QA lifecycle to accelerate test design, documentation, and defect analysis.

Skills

QA testing

Python

SQL

API testing

LLMs

Chatbot frameworks

Copilot

Job description

Parser Limited in Dubai is seeking a Senior QA Engineer to ensure quality across complex data flows and AI-driven products, with emphasis on conversational agents.

You will design and execute tests for data pipelines, APIs, and LLM-based chat systems, build automation in Python, and collaborate with ML/NLP teams to define robust evaluation criteria.

The role offers opportunities to advance QA practices, address safety concerns, and impact real-time validation in a fast-moving AI environment.