Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
AuraOne, Inc. is seeking a Generalist (US Only) reviewer to evaluate model outputs, compare paired responses, and provide structured feedback for retraining. You will apply a versioned rubric, label edge cases, and document recurring issues to help improve the evaluation process.
The role is remote for US-eligible contractors with flexible hours and a minimum of 10 hours per week. Prior experience in evaluation or annotation is preferred, with strong written reasoning and attention to detail.
Generalist (US Only) is a remote evaluation track for reviewing generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
AI data reviewers help turn generalist evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Hourly rate confirmed after the interview process.
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Prior evaluation, annotation, or human-rater experience on generalist evaluation or adjacent content for Generalist (US Only) work. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that names the issue and the rubric clause being applied. Strong attention to detail and the ability to flag when a prompt itself is the problem. Reliable async availability for at least 10 hours per week.