Public Sector Evaluator — Remote Model QA & Feedback

AI Trainer Jobs; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

AuraOne is seeking Government / public administration Evaluators to remotely review prompts and responses against our quality rubric. Reviewers compare paired outputs, label edge cases, and write structured feedback the modeling team can use to retrain.

The role is a contractor position with pay ranging from $80 to $120 per hour, US-eligible, and remote. Responsibilities include evaluating model outputs, tagging issues, and ensuring rubric consistency across long batches.

Qualifications

• Experience evaluating government/public administration content against rubrics.
• Ability to apply rubrics consistently across large batches.
• Strong written communication to name issues and rubric clauses.
• Reliable, asynchronous work availability for at least 10 hours per week.

Responsibilities

• Evaluate government/public administration evaluation model outputs against the rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them for rubric updates.

Skills

Remote evaluation experience

Annotation experience

Clear written reasoning

Attention to detail

Async availability

Job description

AuraOne is seeking Government / public administration Evaluators to remotely review prompts and responses against our quality rubric. Reviewers compare paired outputs, label edge cases, and write structured feedback the modeling team can use to retrain.

The role is a contractor position with pay ranging from $80 to $120 per hour, US-eligible, and remote. Responsibilities include evaluating model outputs, tagging issues, and ensuring rubric consistency across long batches.