AI Quality Assurance Engineer: Drive Model Reliability

Tawantech

Riyad Al Khabra

On-site

SAR 180,000 - 300,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Tawantech is seeking an AI Quality Assurance Engineer to safeguard the quality, reliability, and performance of AI/ML solutions across development and production. The role designs and implements testing strategies for models, data pipelines, APIs, and deployments, ensuring alignment with business, security, and regulatory requirements.

You will collaborate with Data Scientists, AI Engineers, and stakeholders to automate tests, monitor drift, and enforce quality gates within CI/CD pipelines.

Qualifications

  • Bachelor’s degree in CS, data science, AI, engineering, or related field.
  • 5+ years in QA, AI/ML testing, software testing, or data quality.
  • Strong understanding of ML lifecycle processes.
  • Experience with Python and automated testing frameworks.
  • Knowledge of SQL and data validation techniques.
  • Experience with APIs, cloud platforms, CI/CD, and version control.
  • Understanding of ML evaluation metrics and model monitoring.
  • Strong analytical, problem-solving, and communication skills.

Responsibilities

  • Develop and execute QA/testing strategies for AI/ML solutions.
  • Validate AI models for accuracy, consistency, robustness, and performance.
  • Design test cases for ML models, AI apps, APIs, and data pipelines.
  • Perform data quality, data validation, and data integrity testing.
  • Test AI outputs for accuracy, bias, hallucination, reliability, and consistency where applicable.
  • Conduct regression, integration, functional, performance, and automated testing.
  • Establish quality gates and acceptance criteria for AI model deployment.
  • Monitor model performance and identify model/data drift in production.
  • Collaborate with Data Scientists, AI Engineers, Data Engineers, and Business stakeholders.
  • Automate testing processes and integrate QA activities into CI/CD pipelines.
  • Document defects, test results, risks, and remediation activities.
  • Support model governance, auditability, and compliance requirements.

Skills

Python
Automated testing
APIs
Cloud platforms
CI/CD
SQL
Data validation
Model evaluation metrics
Model monitoring
Data quality
Communication skills

Education

Bachelor’s degree

Tools

CI/CD tools

Job description

Tawantech is seeking an AI Quality Assurance Engineer to safeguard the quality, reliability, and performance of AI/ML solutions across development and production. The role designs and implements testing strategies for models, data pipelines, APIs, and deployments, ensuring alignment with business, security, and regulatory requirements.

You will collaborate with Data Scientists, AI Engineers, and stakeholders to automate tests, monitor drift, and enforce quality gates within CI/CD pipelines.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI QA Engineer: ML Testing, Data Quality & CI/CD
Senior AI QA Engineer: ML Testing, Data Quality & CI/CD

Tawantech • Riyadh

On-site
SAR 180,000 - 260,000
AI Quality Assurance Engineer
AI Quality Assurance Engineer

Tawantech • Riyadh

On-site
SAR 180,000 - 260,000
AI Quality Assurance Engineer
AI Quality Assurance Engineer

Tawantech • Riyad Al Khabra

On-site
SAR 180,000 - 300,000
AI QA Engineer — Drive Quality in a Fast-Growth AI Startup
AI QA Engineer — Drive Quality in a Fast-Growth AI Startup

Sarj • Riyadh

On-site
SAR 180,000 - 240,000
QA Analyst - Gen AI
QA Analyst - Gen AI

Silver Edge Arabia • Al Khobar

Hybrid
SAR 150,000 - 230,000
AI QA & Testing Engineer
AI QA & Testing Engineer

Elbetron Technologies • Al Khobar

On-site
SAR 60,000 - 90,000
QA Engineer — AI-Driven Testing for Mobile & API
QA Engineer — AI-Driven Testing for Mobile & API

Gathern • Riyadh

On-site
SAR 61,000 - 73,000
QA Engineer: AI-Driven Mobile & API Testing
QA Engineer: AI-Driven Mobile & API Testing

Gathern • Riyadh

On-site
SAR 84,000 - 168,000
Remote Data QA Engineer — AI-Driven Data Quality
Remote Data QA Engineer — AI-Driven Data Quality

Jobgether • Saudi Arabia

Remote
SAR 337,000 - 525,000
Fully remote
35 days holidays
International team
+3
Senior QA Engineer: AI-Driven Automation & Release Quality
Senior QA Engineer: AI-Driven Automation & Release Quality

Salla • Medina

On-site
SAR 150,000 - 230,000