Remote Data Analysis Evaluator (Contractor)

AI Trainer Jobs; United States; Remote; USD 110,000 - 165,000; Part time

Job summary

AuraOne is seeking a Data analysis / quantitative readouts Evaluator in a remote contractor role. You will review prompts and responses, label edge cases, and provide structured feedback to retrain the modeling system.

Responsibilities include evaluating outputs against a rubric, selecting the stronger answer with rationale, and tagging issues like hallucinations or policy violations. Strong attention to detail and async availability are valued.

Qualifications

• Prior evaluation, annotation, or human-rater experience on data analysis / quantitative readouts evaluation or adjacent content for Data analysis / quantitative readouts Evaluator work.

Responsibilities

• Evaluate data analysis / quantitative readouts evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and provide written rationale for the stronger answer.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.

Skills

Data analysis evaluation

Annotation

Rubric-based annotation

Inter-rater calibration

Job description

AuraOne is seeking a Data analysis / quantitative readouts Evaluator in a remote contractor role. You will review prompts and responses, label edge cases, and provide structured feedback to retrain the modeling system.

Responsibilities include evaluating outputs against a rubric, selecting the stronger answer with rationale, and tagging issues like hallucinations or policy violations. Strong attention to detail and async availability are valued.