Remote Misinformation Context Review Specialist

AuraOne, Inc.; United States; Remote; USD 28,000 - 41,000; Full time

Benefits offered by this job

Remote work

Contractor role

Job summary

AuraOne, Inc. is seeking a remote Misinformation Context Cultural Context Reviewer to evaluate model outputs against a versioned rubric. You will compare paired responses, label edge cases, and provide structured feedback to support retraining efforts.

The role requires clear written reasoning, strong attention to detail, and reliable async availability for at least 10 hours per week. This is a contractor position with US eligibility and remote work options.

Qualifications

• Experience evaluating misinformation context or similar content using rubrics.
• Ability to apply rubric clauses and clearly name issues.
• Strong written reasoning and the ability to flag problems.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and provide a rationale for the stronger answer.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and relay rubric updates to the program team.
• Maintain reviewer-quality scores and calibrate against gold-standard examples.
• Document recurring failure modes for retraining.

Skills

Misinformation context evaluation

Annotation

Written reasoning

Attention to detail

Async availability

Job description

AuraOne, Inc. is seeking a remote Misinformation Context Cultural Context Reviewer to evaluate model outputs against a versioned rubric. You will compare paired responses, label edge cases, and provide structured feedback to support retraining efforts.

The role requires clear written reasoning, strong attention to detail, and reliable async availability for at least 10 hours per week. This is a contractor position with US eligibility and remote work options.