Senior AI QA Engineer: ML Testing, Data Quality & CI/CD

Tawantech; Riyadh; On-site; SAR 180,000 - 260,000; Full time

Job summary

Tawantech in Riyadh seeks an AI Quality Assurance Engineer to ensure the quality, reliability, accuracy, and performance of AI/ML solutions across the development lifecycle. The role develops and implements testing strategies for AI models, data pipelines, AI applications, and production deployments while ensuring solutions meet business, technical, security, and regulatory requirements.

Collaborate with Data Scientists, AI Engineers, Data Engineers, and Business stakeholders to design tests,

Qualifications

• Bachelor’s degree in Computer Science, Data Science, AI, Engineering, or a related field.
• 5+ years of experience in QA, AI/ML testing, software testing, or data quality.
• Strong understanding of machine learning and AI lifecycle processes.
• Experience with Python and automated testing frameworks.
• Knowledge of SQL and data validation techniques.
• Experience with APIs, cloud platforms, CI/CD, and version control.
• Understanding of ML model evaluation metrics and model monitoring.
• Strong analytical, problem-solving, and communication skills.

Responsibilities

• Develop and execute comprehensive QA and testing strategies for AI/ML solutions.
• Validate AI models for accuracy, consistency, robustness, and performance.
• Design test cases for ML models, AI apps, APIs, and data pipelines.
• Perform data quality, data validation, and data integrity testing.
• Test AI outputs for accuracy, bias, hallucination, reliability, and consistency where applicable.
• Conduct regression, integration, functional, performance, and automated testing.
• Establish quality gates and acceptance criteria for AI model deployment.
• Monitor model performance and identify model/data drift in production.
• Collaborate with Data Scientists, AI Engineers, Data Engineers, and Business stakeholders.
• Automate testing processes and integrate QA into CI/CD pipelines.
• Document defects, test results, risks, and remediation activities.
• Support model governance, auditability, and compliance requirements.

Skills

QA testing

AI/ML testing

Data quality

Data validation

Model monitoring

Python

SQL

CI/CD

APIs

communication

Education

Bachelor's degree in Computer Science, Data Science, AI, Engineering, or related field

Tools

Python

SQL

APIs

CI/CD

Cloud platforms

Version control

Job description

Tawantech in Riyadh seeks an AI Quality Assurance Engineer to ensure the quality, reliability, accuracy, and performance of AI/ML solutions across the development lifecycle. The role develops and implements testing strategies for AI models, data pipelines, AI applications, and production deployments while ensuring solutions meet business, technical, security, and regulatory requirements.

Collaborate with Data Scientists, AI Engineers, Data Engineers, and Business stakeholders to design tests,