QA Analyst

Client of Ethra Hr; Eastern Province; On-site; SAR 167,000 - 268,000; Full time

Job summary

Client of Ethra Hr is seeking a QA Analyst in Al Khobar to drive end-to-end and integration testing for Generative AI-driven applications. You will validate AI model outputs, data integrity, and API interactions while ensuring UI accessibility across browsers and devices.

The role requires 3-5 years of QA experience with mandatory Playwright, strong Pytest, SQL, Python coding, and experience with Selenium, Cypress and Robot Framework. CI/CD and Agile experience preferred.

Qualifications

• 3-5 years of experience in quality assurance focusing on functional and integration testing.
• Mandatory Playwright experience.
• Strong Pytest and SQL hands-on experience.
• Hands-on coding in Python.
• Proficiency with Selenium, Cypress, and Robot Framework.
• API testing with Postman and SoapUI.
• Familiarity with performance testing using JMeter.
• Knowledge of AI model validation and data integrity testing.

Responsibilities

• Execute end-to-end and integration testing for AI-driven apps.
• Validate workflows, user journeys, API interactions, and AI outputs.
• Conduct UI/UX testing across devices and browsers.
• Support user acceptance testing activities.
• Validate training/test datasets for AI models.
• Ensure data integrity and real-world alignment of synthetic data.
• Test data pipelines and data flow between AI models and services.
• Automate regression and frequent deployments.
• Perform API testing with Postman and SoapUI.
• Assist security and regulatory validation.

Skills

Python coding

Playwright

Pytest

SQL

QA testing

API testing

JMeter

AI model validation

Tools

Selenium

Cypress

Robot Framework

Postman

SoapUI

Job description

On behalf of our client we are seeking a QA Analyst to join their team in Al Khobar The QA Analyst will play a critical role in executing and automating functional and non-functional testing for Generative AI-driven applications ensuring that AI models APIs and user interfaces are reliable scalable and secure The role will cover end-to-end and integration testing AI model and data validation test automation API testing performance testing and post-deployment testing The position requires strong hands‑on experience in QA and test automation with Python as a must-have and additional emphasis on Playwright Pytest SQL and coding experience in Python Responsibilities Execute end-to-end and integration testing to validate AI-driven actions and ensure products function according to specified requirements Validate workflows user journeys API interactions and AI model outputs against business logic Conduct UI UX testing to validate accessibility responsiveness and usability across devices and browsers Support user acceptance testing activities Validate input datasets for training testing and fine-tuning of AI models Ensure data integrity preprocessing workflows and real-world alignment of synthetic data Validate data pipelines and data flow between AI models backend services and frontend applications Test models against predefined scenarios including edge cases and adversarial inputs Support performance load and stress testing using tools such as JMeter Automate test cases for regression and frequent deployments Validate new builds releases and updates continuously Track defects log issues and verify fixes in collaboration with development teams Monitor production model performance and analyse results for quality improvements Implement test automation for functional and regression testing Conduct API testing using Postman and SoapUI Assist in security and compliance validation and ensure data protection and regulatory adherence.

Responsibilities

• Execute end-to-end and integration testing to validate AI-driven actions and ensure products function according to specified requirements
• Validate workflows user journeys API interactions and AI model outputs against business logic
• Conduct UI UX testing to validate accessibility responsiveness and usability across devices and browsers
• Support user acceptance testing activities
• Validate input datasets for training testing and fine-tuning of AI models
• Ensure data integrity preprocessing workflows and real-world alignment of synthetic data
• Validate data pipelines and data flow between AI models backend services and frontend applications
• Test models against predefined scenarios including edge cases and adversarial inputs
• Support performance load and stress testing using tools such as JMeter
• Automate test cases for regression and frequent deployments
• Validate new builds releases and updates continuously
• Track defects log issues and verify fixes in collaboration with development teams
• Monitor production model performance and analyse results for quality improvements
• Implement test automation for functional and regression testing
• Conduct API testing using Postman and SoapUI
• Assist in security and compliance validation and ensure data protection and regulatory adherence

3-5 years of experience in quality assurance, with a focus on functional and integration testing. Playwright experience — mandatory. Pytest experience. Hands-on SQL experience. Hands-on coding experience in Python. Proficiency in test automation tools including Selenium, Cypress, and Robot Framework. API testing experience using Postman and SoapUI. Strong knowledge of AI model validation techniques and data integrity testing. LLM evaluation experience is a plus. Familiarity with performance testing tools such as JMeter. Security testing experience is an advantage. Experience working in Agile environments with CI/CD pipeline integration. Strong analytical skills with attention to detail in test execution and reporting.