Remote Government Document Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 68,000 - 97,000; Part time

Job summary

AuraOne is seeking remote contractors to review document annotation outputs under a fixed rubric. You will evaluate text, images, and mixed inputs, write clear rationales, and flag issues for model retraining. The role emphasizes independent work, weekly calibration, and attention to edge cases.

The position is remote for US-eligible candidates, with compensation at $60 per hour and contractor terms. Strong linguistic and analytical skills are essential.

Qualifications

• Prior evaluation, annotation, or human-rater experience on document annotation or adjacent content for Government Backoffice — Visual Document Understanding work.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate document annotation model outputs against a versioned rubric and assign severity tags for Government Backoffice — Visual Document Understanding assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Document evaluation

Clear rationale writing

Attention to detail

Async availability

Job description

AuraOne is seeking remote contractors to review document annotation outputs under a fixed rubric. You will evaluate text, images, and mixed inputs, write clear rationales, and flag issues for model retraining. The role emphasizes independent work, weekly calibration, and attention to edge cases.

The position is remote for US-eligible candidates, with compensation at $60 per hour and contractor terms. Strong linguistic and analytical skills are essential.