Engineer - ML QA

Inception42

Abu Dhabi

On-site

AED 300,000 - 600,000

Full time

9 days ago
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Inception42, a G42 company, seeks an Engineer - ML QA to drive quality assurance for ML models and AI solutions. You will work with data scientists, engineers, and product teams to validate models, implement testing plans, and ensure safety, relevance, and retrieval quality of AI systems.

The role emphasizes leading QA activities, designing end-to-end QA strategies, and staying current with tools like Playwright, Selenium, and DeepEval within an ambitious AI-focused environment.

Qualifications

  • Bachelor’s degree in CS/engineering or related field.
  • 5+ years in QA with at least 2 years in leadership.
  • Experience with QA methodologies, tools, and processes.
  • Understanding of ML product lifecycle and data quality checks.
  • Proven ability to write clear, concise test plans and cases.
  • Familiarity with SDLC and agile methodologies.
  • Experience with cloud services and architectures.

Responsibilities

  • Execute QA processes for ML models to ensure quality standards.
  • Collaborate with ML scientists, software engineers and product managers.
  • Design, implement, and oversee ML QA strategy for products and services.
  • Create and run manual and automated test plans and test cases.
  • Validate AI chat and RAG applications for accuracy and safety.
  • Implement DeepEval-based evaluation and automated pipelines.
  • Monitor QA results and report to senior management.
  • Lead root cause analysis and complex problem solving.
  • Stay updated on QA tools/frameworks and promote adoption.
  • Ensure compliance with industry and company quality standards.

Skills

QA leadership
QA methodologies
data quality assessment
test planning
SDLC & Agile
Python/Java/SQL
Cloud basics
Monitoring tools
LLM evaluation
Auto/Manual testing

Education

Bachelor’s degree in Computer Science or related field

Tools

Playwright
Selenium
JUnit
PyTest
Gatling
Postman
RestAssured
Grafana
Kibana
Azure

Job description

Inception42, a G42 company, is the region’s leading innovator of AI-powered domain-specific as well as industry-agnostic products, built on a rich heritage of research and development. Within the G42 ecosystem, Inception42 functions as the core intelligence layer – transforming data and compute infrastructure into real-world, applied AI solutions. Beyond its commercial endeavors, Inception42 is committed to creating positive societal impact. For more information, please visit www.inceptionai.ai

Overview:

As an Engineer - ML QA at Inception, you will be responsible for developing and executing quality assurance processes to ensure the accuracy, reliability, and performance of machine learning models and AI applications. you will work closely with data scientists, software engineers, and product teams to validate ML models and systems. Your role is crucial in maintaining high standards of quality for the company's AI & machine learning initiatives.

What You’ll Own:

As an Engineer - ML QA, you will be responsible for executing QA processes for machine learning models to ensure they meet the company’s quality standards. Your role will encompass a range of activities focused on model validation, testing, and collaboration.

  • Collaborate with a team of ML QA engineers to ensure the highest quality product delivery.
  • Design, implement, and oversee the overall ML QA strategy for machine learning-based products and services.
  • Collaborate closely with cross-functional teams, including software engineers, machine learning scientists, and product managers.
  • Design and execute test plans, including manual and automated test cases.
  • Validate AI chat and RAG applications for response accuracy, relevance, groundedness, hallucination, safety, and retrieval quality.
  • Implement LLM-as-a-Judge evaluation approaches and automated evaluation pipelines using DeepEval.
  • Monitor ML QA results and metrics, and report findings to senior management.
  • Lead root cause analysis and complex problem-solving initiatives for project issues.
  • Maintain up-to-date knowledge of the latest QA tools, frameworks, and best practices, and drive adoption across the QA team.
  • Ensure compliance with industry and company quality standards.
What We’re Looking For:
  • Bachelor’s degree in computer science, Engineering, or a related technical field.
  • Minimum of 5 years of experience in a QA role, with at least 2 years in a leadership position.
  • In-depth experience with QA methodologies, tools, and processes.
  • Understanding of machine learning products lifecycle.
  • Strong experience with data quality assessment.
  • Proven experience in writing clear, concise, and comprehensive test plans and test cases.
  • Familiarity with software development lifecycle (SDLC) and agile methodologies.
  • Experience with cloud-based services and architectures.
  • Strong problem-solving skills and excellent attention to detail.
  • Domain experience in health, finance or climate industry is a plus.
  • Excellent verbal and written communication skills.
  • Programming languages: Python, Java, SQL
  • Testing Tools: Playwright, Selenium, JUnit, PyTest, Gatling, Postman, RestAssured
  • LLM Evaluation: DeepEval, LLM-as-a-Judge, AI Chat and RAG validation
  • Cloud Services: Azure (optional AWS, GCP)
  • Monitoring Tools: Grafana, Kibana
Why Inception42

Inception42 is building AI systems designed for practical deployment at scale — across industries, infrastructure, and national-level initiatives.

If you want to work close to both advanced AI capability and real-world execution, we’d like to hear from you.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Engineer - ML QA
Lead Engineer - ML QA

Inception42 • Abu Dhabi

On-site
AED 420,000 - 640,000
Healthcare
Education support
Leave benefits
Senior ML QA Engineer — AI Model Validation & Quality
Senior ML QA Engineer — AI Model Validation & Quality

Inception42 • Abu Dhabi

On-site
AED 300,000 - 600,000
MLOps Engineer
MLOps Engineer

Inception42 • Abu Dhabi Emirate

On-site
AED 350,000 - 550,000
Senior Quality Assurance Engineer
Senior Quality Assurance Engineer

Institute of Foundation Models • Abu Dhabi

On-site
AED 167,400 - 223,200
Senior ML QA Lead - AI-Driven Financial Testing
Senior ML QA Lead - AI-Driven Financial Testing

Inception42 • Abu Dhabi

On-site
AED 420,000 - 640,000
Healthcare
Education support
Leave benefits
Director - Software Engineering
Director - Software Engineering

Showcify, Inc. • Abu Dhabi

On-site
AED 600,000 - 900,000
Healthcare
Education support
Leave benefits
Director - Software Engineering
Director - Software Engineering

Inception42 • Abu Dhabi

On-site
AED 240,000 - 420,000
Senior Manager - Solution Engineering
Senior Manager - Solution Engineering

inception42 • Abu Dhabi

On-site
AED 350,000 - 550,000
Principal Software Engineer
Principal Software Engineer

Showcify, Inc. • Abu Dhabi

On-site
AED 420,000 - 780,000
Healthcare
Education support
Leave benefits
Data Engineer
Data Engineer

Showcify • Abu Dhabi

On-site
AED 220,000 - 320,000
Healthcare
Education support
Leave benefits