Moonlight MCQA: Norwegian Generalist Evaluator (Remote)

AI Trainer Jobs; United States; Remote; USD 68,000 - 81,000; Part time

Job summary

AuraOne seeks evaluators for Moonlight MCQA - Norwegian Generalist to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining the model.

AI data reviewers help generate auditable labels, rationales, and regression cases for AuraOne Human Data. Responsibilities include evaluating outputs, tagging errors, and coordinating with the program team to improve the rubric.

Qualifications

• Experience evaluating ML model outputs against rubrics.
• Ability to apply grading rubrics consistently across long batches.
• Experience labeling content with structured tags for quality review.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route to rubric updates.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Moonlight MCQA Norwegian Generalist

Job description

AuraOne seeks evaluators for Moonlight MCQA - Norwegian Generalist to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining the model.

AI data reviewers help generate auditable labels, rationales, and regression cases for AuraOne Human Data. Responsibilities include evaluating outputs, tagging errors, and coordinating with the program team to improve the rubric.