Remote Video Recorder Evaluation Specialist

AuraOne; United States; Remote; USD 28,000 - 55,000; Full time

Benefits offered by this job

Remote work

Contractor pay after interview

Job summary

AI Trainer Jobs seeks a Generalist - Video Recorder reviewer for AuraOne Human Data. This remote contractor role evaluates model outputs, labels edge cases, and writes structured feedback used to retrain the system.

You will compare paired responses, tag hallucinations and unsafe content, and calibrate against gold-standard examples weekly. Strong attention to detail and async availability are essential.

Qualifications

• Prior evaluation, annotation, or human-rater experience on generalist video recorder evaluation or adjacent content.
• Clear written reasoning naming the rubric clause being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and route to the program team.
• Maintain reviewer-quality scores by calibrating against gold-standard examples.

Skills

Generalist video recorder evaluation

Inter-rater calibration

Attention to detail

Structured feedback

Job description

AI Trainer Jobs seeks a Generalist - Video Recorder reviewer for AuraOne Human Data. This remote contractor role evaluates model outputs, labels edge cases, and writes structured feedback used to retrain the system.

You will compare paired responses, tag hallucinations and unsafe content, and calibrate against gold-standard examples weekly. Strong attention to detail and async availability are essential.