Remote AI Data Evaluator: Video Recorder QA (Japan)

AuraOne Human Data; United States; À distance; USD 21 000 - 34 000; Temps partiel

Résumé du poste

AuraOne, Inc. is seeking an independent contractor for remote evaluation of at-home video recorder prompts and responses. You will review outputs, apply a versioned rubric, and label edge cases with structured feedback to aid retraining efforts.

The role emphasizes clear written rationales and calibration against gold standards. The position is remote, US-eligible, and compensation is hourly, with rate determined after the interview process.

Qualifications

• Prior evaluation, annotation, or human-rater experience on at home video recorder evaluation or adjacent content.
• Clear written reasoning that names the issue and the rubric clause being applied.

Responsabilités

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and provide a written rationale for stronger answers.
• Label hallucinations and unsafe content with structured tags.
• Capture ambiguous prompts and route them for rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.
• Document recurring failure modes for future training.

Connaissances

Model evaluation

Rubric annotation

Severity tagging

Inter-rater calibration

At home data review

Design

Description du poste

AuraOne, Inc. is seeking an independent contractor for remote evaluation of at-home video recorder prompts and responses. You will review outputs, apply a versioned rubric, and label edge cases with structured feedback to aid retraining efforts.

The role emphasizes clear written rationales and calibration against gold standards. The position is remote, US-eligible, and compensation is hourly, with rate determined after the interview process.