Remote Yoruba Language Evaluation Specialist

Auraone

United States

Remote

USD 28,000 - 55,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AI Trainer Jobs seeks a Yoruba Language Expert for remote evaluation tasks. You will review Yoruba prompts and model outputs against AuraOne's rubric, label edge cases, and provide structured feedback to retrain models.

Responsibilities include comparing responses, tagging issues, and calibrating reviewer scores weekly. This contractor role requires clear reasoning and reliable async availability of at least 10 hours per week.

Qualifications

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Ability to flag when a prompt itself is the problem.

Responsibilities

  • Evaluate Yoruba language evaluation model outputs against a rubric and tag severity.
  • Compare paired responses and select the stronger answer with rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples.

Skills

Prior evaluation experience
Attention to detail
Written reasoning
Async availability

Tools

Annotation tools

Job description

AI Trainer Jobs seeks a Yoruba Language Expert for remote evaluation tasks. You will review Yoruba prompts and model outputs against AuraOne's rubric, label edge cases, and provide structured feedback to retrain models.

Responsibilities include comparing responses, tagging issues, and calibrating reviewer scores weekly. This contractor role requires clear reasoning and reliable async availability of at least 10 hours per week.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Yoruba AI Trainer & Language Specialist
Remote Yoruba AI Trainer & Language Specialist

Agency • United States

Remote
USD 11,000 - 90,000
Remote Yoruba AI Language Trainer & Specialist
Remote Yoruba AI Language Trainer & Specialist

Meridial • United States

Remote
USD 11,000 - 90,000
Yoruba Language Expert
Yoruba Language Expert

Auraone • United States

Remote
USD 28,000 - 55,000
Remote English & Odia Evaluation Specialist
Remote English & Odia Evaluation Specialist

Auraone • United States

Remote
USD 21,000 - 28,000
Remote Yoruba AI Trainer & Linguistic Specialist
Remote Yoruba AI Trainer & Linguistic Specialist

Invisible Technologies Inc. • United States

Remote
USD 54,000 - 90,000
Remote Evaluation Specialist: English & Telugu
Remote Evaluation Specialist: English & Telugu

Auraone • United States

Remote
USD 21,000 - 28,000
Remote Yoruba AI Tutor & Audio Data Annotator
Remote Yoruba AI Tutor & Audio Data Annotator

xAI • United States

Remote
USD 28,000 - 48,000
Yoruba Language Specialist - Freelance AI Trainer Project
Yoruba Language Specialist - Freelance AI Trainer Project

Agency • United States

Remote
USD 11,000 - 90,000
Yoruba Language Specialist - Freelance AI Trainer Project
Yoruba Language Specialist - Freelance AI Trainer Project

Meridial • United States

Remote
USD 11,020 - 89,544
Flexible working hours
Work from home
Yoruba Language Specialist
Yoruba Language Specialist

Meridial • United States

Remote
USD 11,000 - 90,000