Remote Mongolian Bilingual Evaluator

AuraOne; United States; Remote; USD 34,000 - 62,000; Part time

Job summary

AI Trainer Jobs is seeking a Mongolian Bilingual Expert for a remote evaluation track. You will review prompts and model outputs against a versioned rubric, label edge cases, and provide structured feedback for retraining.

The role emphasizes accuracy, clear reasoning, and weekly calibration with gold-standard examples. As an independent contractor, you will review frontier model outputs, compare pairs, and route ambiguous prompts to the program team.

Qualifications

• Experience evaluating bilingual or multilingual content.
• Ability applying rubrics consistently across long batches.
• Clear written reasoning naming issues and rubric clauses.
• Attention to detail and ability to flag problematic prompts.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Mongolian bilingual evaluation outputs against rubric and assign severity tags.
• Compare paired responses and provide a rationale for the stronger answer.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route for rubric updates.
• Calibrate reviewer quality against gold-standard examples weekly.

Skills

Linguistics

Content moderation

Trust & safety

Inter-rater calibration

Evaluation annotation

Job description

AI Trainer Jobs is seeking a Mongolian Bilingual Expert for a remote evaluation track. You will review prompts and model outputs against a versioned rubric, label edge cases, and provide structured feedback for retraining.

The role emphasizes accuracy, clear reasoning, and weekly calibration with gold-standard examples. As an independent contractor, you will review frontier model outputs, compare pairs, and route ambiguous prompts to the program team.