Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
AuraOne, Inc. is seeking an AI Evaluation Rubric Reviewer for a remote contractor role. You will assess model outputs against AuraOne's rubric, label edge cases, and provide structured feedback for retraining.
Responsibilities include evaluating rubric outputs, tagging issues, calibrating scores, and documenting recurring failure modes. Must have prior evaluation or annotation experience and be available at least 10 hours per week.
AI Evaluation Rubric Reviewer is a remote evaluation track for reviewing ai evaluation rubric evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
AI data reviewers help turn ai evaluation rubric evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Remote - US-eligible. Remote Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
$40-$75 / hr
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Prior evaluation, annotation, or human-rater experience on ai evaluation rubric evaluation or adjacent content for AI Evaluation Rubric Reviewer work. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that names the issue and the rubric clause being applied. Strong attention to detail and the ability to flag when a prompt itself is the problem. Reliable async availability for at least 10 hours per week.