Remote Arabic Localization & Cultural Context Evaluator

AI Trainer Jobs; United States; Remote; USD 28,000 - 48,000; Part time

Benefits offered by this job

Remote

Job summary

AuraOne is seeking an Arabic Localization Cultural Context Reviewer for a remote, contractor-based role. You will review and rate arabic generalist evaluation prompts and responses using a versioned rubric, label edge cases, and provide structured feedback for retraining the model.

Responsibilities include comparing paired outputs, tagging issues, and calibrating across batches to maintain quality. The role demands strong written reasoning and at least 10 hours per week of async availability.

Qualifications

• Bachelor-level or higher in linguistics, languages, or a related field preferred.
• Experience evaluating Arabic prompts or content using rubrics is a plus.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names issues and rubric clauses is essential.

Responsibilities

• Evaluate Arabic outputs against a versioned rubric and tag severity levels.
• Compare paired responses and select the stronger with a rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Flag ambiguous prompts and suggest rubric updates to improve future reviews.
• Maintain reviewer quality scores by calibration against gold-standard examples weekly.

Skills

Arabic language

Attention to detail

Written reasoning

Inter-rater calibration

Education

Linguistics background

Job description

AuraOne is seeking an Arabic Localization Cultural Context Reviewer for a remote, contractor-based role. You will review and rate arabic generalist evaluation prompts and responses using a versioned rubric, label edge cases, and provide structured feedback for retraining the model.

Responsibilities include comparing paired outputs, tagging issues, and calibrating across batches to maintain quality. The role demands strong written reasoning and at least 10 hours per week of async availability.