Remote AI Data Reviewer – Video Recorder Evaluations

AuraOne Human Data; United States; Remote; USD 25,000 - 39,000; Full time

Job summary

AuraOne, Inc. is seeking a remote Independent specialist contractor to evaluate AI model outputs against a structured rubric. You will provide detailed rationales and severity tags to help improve model performance in the At Home Video Recorder evaluation track.

In this role you will compare responses, label edge cases, and document recurring failure modes to steer future training efforts. A strong attention to detail and reliable weekly availability are essential for success.

Qualifications

• Experience evaluating or annotating AI model outputs against rubrics.
• Ability to write clear rationales and tie judgments to rubric clauses.
• Strong attention to detail and ability to flag content issues.
• Reliable availability for remote work at least 10 hours per week.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with written rationale.
• Tag hallucinations, instruction-following failures, and unsafe content.
• Document recurring failure modes to guide future training.
• Calibrate scores against gold-standard examples weekly.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

At Home Video Recorder evaluation

Design

Job description

AuraOne, Inc. is seeking a remote Independent specialist contractor to evaluate AI model outputs against a structured rubric. You will provide detailed rationales and severity tags to help improve model performance in the At Home Video Recorder evaluation track.

In this role you will compare responses, label edge cases, and document recurring failure modes to steer future training efforts. A strong attention to detail and reliable weekly availability are essential for success.