Moonlight MCQA - Arabic Generalist

AI Trainer Jobs; United States; Remote; USD 33,000 - 41,000; Full time

Job summary

AuraOne seeks a Moonlight MCQA - Arabic Generalist to remotely evaluate Arabic outputs against native-speaker standards. Reviewers assess fluency, register, and cultural-context accuracy, then provide structured rationale for model improvement in the next training cycle.

Responsibilities include comparing Arabic responses, flagging errors, and documenting native-speaker edits with clear naming of issues and applied standards. This remote contractor role is US-eligible with hourly compensation.

Qualifications

• Native or near-native Arabic fluency with strong written-English ability.
• Experience editing, translating, or evaluating Arabic content.
• Ability apply rubrics consistently across long evaluation batches.

Responsibilities

• Evaluate Arabic model responses for fluency, accuracy, register, and cultural fit.
• Compare paired Arabic outputs and select the stronger one with rationale.
• Flag hallucinations, code-switching, and tone mismatches with severity tags.

Skills

Arabic fluency

Native-speaker review

Rubric application

LLM output evaluation

Arabic evaluation

Education

Background in Arabic linguistics

Tools

TMS tools

MQM error taxonomies

Job description

Moonlight MCQA - Arabic Generalist is a remote Arabic specialist track for evaluating arabic evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale that the modeling team can act on in the next training cycle.

Category: Language, Localization & Culture · Pay: $24–$30 / hr · Location: Remote — US-eligible · Contractor

Moonlight MCQA - Arabic Generalist is a remote Arabic specialist track for evaluating arabic evaluation outputs against native-speaker standards.

Role details

About the role

Moonlight MCQA - Arabic Generalist is a remote Arabic specialist track for evaluating arabic evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale that the modeling team can act on in the next training cycle.
Multilingual model quality depends on reviewers who can read Arabic the way a native speaker does. AuraOne uses these reviewers to set the bar for tone, formality, and cultural register before a model ever ships to Arabic users.
Review translation and localization work. Dialect and cultural context matter here.

Responsibilities

• Evaluate Arabic model responses for fluency, accuracy, register, and cultural fit for Moonlight MCQA - Arabic Generalist assignments.
• Compare paired arabic evaluation outputs and pick the stronger response with a written rationale.
• Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
• Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.Track Language evaluation Work model Remote · Independent specialist contractor Compensation $24–$30 / hr Eligible from US

What you should bring

• Native or near-native Arabic fluency with strong written-English ability for Moonlight MCQA - Arabic Generalist work.
• Demonstrable experience editing, translating, or evaluating Arabic content.
• Comfort applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.
• Reliable async availability for at least 10 hours per week.
• Prior model-evaluation, annotation, or human-rater experience is a plus.

Role signals

Example tasks

• Score a pair of Arabic responses to a customer-support prompt and pick the better one with a 1-2 sentence rationale.
• Flag formality mismatches in arabic evaluation outputs (T/V usage, honorifics, regional register).
• Rewrite a model's Arabic response so it reads naturally and tag the original error category.
• Audit a 50-row evaluation batch for rubric consistency and surface drift back to the program lead.

Useful experience

• Background in Arabic linguistics, journalism, or translation studies.
• Experience with TMS tools, MQM error taxonomies, or other structured QA frameworks.
• Familiarity with LLM evaluation rubrics and inter-rater agreement workflows.

Compensation and schedule

$24–$30 / hr
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Multilingual evaluation
• Native-speaker review
• Rubric application
• LLM output evaluation
• Arabic evaluation