Senior QA Automation Engineer - AI & Conversational Testing

parser; España; Híbrido; EUR 60.000 - 80.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical insurance

Hybrid working environment

Competitive compensation

Descripción de la vacante

Parser is seeking a Senior QA Engineer to safeguard quality across complex data flows and AI-driven products, with a focus on conversational agents. You will design automated tests, validate data outputs, and ensure safe, reliable behavior of generative AI systems.

The role requires 8+ years in QA, strong automation experience with JS/Python, API testing, and familiarity with LLM tools. This position offers a hybrid work model for Dubai-based candidates and a competitive compensation package.

Formación

• 8+ years of experience in QA engineering with automation testing.
• 5+ years of experience in testing data systems.
• Fluent Arabic language skills (spoken and written).
• Strong experience in using AI applications for testing.
• Experience with API testing (manual and automated).
• Familiarity with chatbot frameworks, LLMs, or conversational testing.
• Experience in using LLM-based assistants (e.g., GitHub Copilot, ChatGPT) in test and execution.
• Exposure to QA automation tools (e.g., PyTest, Postman, dbt tests).

Responsabilidades

• Design and execute generative AI testing scenarios, including exploratory testing for chatbot interactions, intent recognition, tone, and edge-case behavior.
• Experience with designing and executing conversational agents.
• Experience in LLM test designs, including prompt and grounding validation, golden sets, and non-deterministic assertions.
• Perform crucial safety and quality checks, such as testing for hallucination, bias, toxicity, and PII leakage.
• Validate structured and unstructured data outputs, ensuring consistency, accuracy, and compliance.
• Establish and drive real-time testing approaches, including streaming data validation and API monitoring.
• Collaborate with ML and NLP teams to define comprehensive evaluation metrics and criteria for agent performance.
• Integrate AI-driven tools into the QA lifecycle to accelerate test design, documentation, and defect analysis.

Conocimientos

Automation testing

JavaScript

Python

API testing

Data testing

LLM testing

Analytical thinking

Attention to detail

Conversational testing

QA tooling familiarity

Herramientas

PyTest

Postman

dbt tests

Descripción del empleo

Parser is seeking a Senior QA Engineer to safeguard quality across complex data flows and AI-driven products, with a focus on conversational agents. You will design automated tests, validate data outputs, and ensure safe, reliable behavior of generative AI systems.

The role requires 8+ years in QA, strong automation experience with JS/Python, API testing, and familiarity with LLM tools. This position offers a hybrid work model for Dubai-based candidates and a competitive compensation package.