Remote AI Evaluator & Quality Trainer for Model Excellence

YO IT Consulting; Dubai; On-site; AED 140,000 - 210,000; Part time

Job summary

YO IT Consulting is seeking an AI Trainer and Evaluator to review content used for training and assessing advanced AI models. You will apply scoring rubrics, categorize datasets, and document recurring model weaknesses in a fully remote contractor role.

The ideal candidate has a Bachelor’s degree and strong analytical, reading, and English communication skills with experience in evaluating large volumes of content against defined criteria.

Qualifications

• Bachelor's degree from a recognized institution.
• Strong critical reading, reasoning, and analytical skills.
• Exceptional attention to detail and accuracy.
• Experience evaluating, reviewing, or scoring large volumes of content against defined criteria.
• Ability to interpret complex rubrics and apply them consistently.
• Strong written and verbal English communication skills.
• Ability to explain nuanced quality issues clearly and objectively.
• Experience identifying factual errors, weak reasoning, contradictions, and instruction failures.
• Good organizational skills for maintaining evaluation records and annotation documentation.
• Ability to work independently in a fully remote contractor environment.
• Familiarity with annotation tools and AI evaluation platforms is preferred.

Responsibilities

• Review content used to train and assess advanced AI models.
• Apply scoring rubrics and categorize datasets.
• Document recurring model weaknesses and explain rationale clearly.
• Maintain evaluation records to support model improvement efforts.

Education

Bachelor's degree

Tools

Annotation tools

AI evaluation platforms

Dashboards

Quality trackers

Job description

YO IT Consulting is seeking an AI Trainer and Evaluator to review content used for training and assessing advanced AI models. You will apply scoring rubrics, categorize datasets, and document recurring model weaknesses in a fully remote contractor role.

The ideal candidate has a Bachelor’s degree and strong analytical, reading, and English communication skills with experience in evaluating large volumes of content against defined criteria.