Luganda Language Evaluator - Remote Feedback Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AuraOne is seeking a Luganda Language Expert for a remote evaluation track to review Luganda prompts and model outputs against a quality rubric. Reviewers compare paired outputs, label edge cases, and draft structured feedback for retraining.

As a remote independent contractor, you will help produce auditable labels, rationales, and regression cases for AuraOne Human Data. Review frontier model outputs and calibrate peers as part of the program.

Qualifications

• Experience evaluating Luganda language evaluation or related content.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.

Responsibilities

• Evaluate Luganda language outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.

Skills

Luganda evaluation

Inter-rater calibration

Written reasoning

Job description

AuraOne is seeking a Luganda Language Expert for a remote evaluation track to review Luganda prompts and model outputs against a quality rubric. Reviewers compare paired outputs, label edge cases, and draft structured feedback for retraining.

As a remote independent contractor, you will help produce auditable labels, rationales, and regression cases for AuraOne Human Data. Review frontier model outputs and calibrate peers as part of the program.