Public-Sector RFI Evaluation Specialist (Remote)

AuraOne; United States; Remote; USD 110.000 - 165.000; Teilzeit

Zusammenfassung

AI Trainer Jobs is seeking a remote Public-sector procurement / RFI response Evaluator to review prompts and model outputs against AuraOne's quality rubric. You will assess paired responses, label edge cases, and provide structured feedback for retraining.

This independent contractor role requires clear written reasoning, careful attention to detail, and reliability for at least 10 hours per week. Compensation ranges from $80 to $120 per hour, with placement depending on program demand.

Qualifikationen

• Experience performing evaluation, annotation, or human-rater work on public sector procurement or RFI content.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause applied.
• Reliable async availability for at least 10 hours per week.

Aufgaben

• Evaluate public sector procurement / rfi response evaluation model outputs against a versioned rubric and assign severity tags for Public-sector procurement / RFI response Evaluator assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.

Kenntnisse

Evaluation experience

Attention to detail

Written reasoning

Async availability

Tools

Rubric-based annotation

Jobbeschreibung

AI Trainer Jobs is seeking a remote Public-sector procurement / RFI response Evaluator to review prompts and model outputs against AuraOne's quality rubric. You will assess paired responses, label edge cases, and provide structured feedback for retraining.

This independent contractor role requires clear written reasoning, careful attention to detail, and reliability for at least 10 hours per week. Compensation ranges from $80 to $120 per hour, with placement depending on program demand.