Remote Data Analysis Evaluator (Contractor)

Auraone

United States

Remote

USD 110,000 - 165,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne is seeking a Data analysis / quantitative readouts Evaluator in a remote contractor role. You will review prompts and responses, label edge cases, and provide structured feedback to retrain the modeling system.

Responsibilities include evaluating outputs against a rubric, selecting the stronger answer with rationale, and tagging issues like hallucinations or policy violations. Strong attention to detail and async availability are valued.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on data analysis / quantitative readouts evaluation or adjacent content for Data analysis / quantitative readouts Evaluator work.

Responsibilities

  • Evaluate data analysis / quantitative readouts evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and provide written rationale for the stronger answer.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.

Skills

Data analysis evaluation
Annotation
Rubric-based annotation
Inter-rater calibration

Job description

AuraOne is seeking a Data analysis / quantitative readouts Evaluator in a remote contractor role. You will review prompts and responses, label edge cases, and provide structured feedback to retrain the modeling system.

Responsibilities include evaluating outputs against a rubric, selecting the stronger answer with rationale, and tagging issues like hallucinations or policy violations. Strong attention to detail and async availability are valued.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Human Data QA & Evaluation Reviewer
Remote Human Data QA & Evaluation Reviewer

Auraone • United States

Remote
USD 34,000 - 55,000
Remote work
Contractor role
Flexible hours
Remote Data QA & AI Output Reviewer (Contractor)
Remote Data QA & AI Output Reviewer (Contractor)

AuraOne Human Data • United States

Remote
USD 69,000 - 83,000
Remote Data Quality & CRM Evaluation Specialist
Remote Data Quality & CRM Evaluation Specialist

Auraone • United States

Remote
USD 110,000 - 165,000
Remote Data Evaluator for Model Feedback & Rubrics
Remote Data Evaluator for Model Feedback & Rubrics

Auraone • United States

Remote
USD 21,000 - 34,000
Remote Diagram Reasoning Evaluator (Contractor)
Remote Diagram Reasoning Evaluator (Contractor)

AuraOne Human Data • United States

Remote
USD 28,000 - 41,000
Senior Data Scientist-Remote Engineering Review Contractor
Senior Data Scientist-Remote Engineering Review Contractor

AuraOne Human Data • United States

Remote
USD 165,000 - 248,000
AI Evaluation Data Analyst — Remotely Review & Calibrate
AI Evaluation Data Analyst — Remotely Review & Calibrate

Auraone • United States

Remote
USD 97,000 - 138,000
Remote Historical Reasoning AI Evaluator & Feedback
Remote Historical Reasoning AI Evaluator & Feedback

AuraOne, Inc. • United States

Remote
USD 34,000 - 62,000
Remote work
Contractor role
Remote AI Data Annotation Evaluator & Quality Reviewer
Remote AI Data Annotation Evaluator & Quality Reviewer

AuraOne, Inc. • United States

Remote
USD 28,000 - 41,000
Remote AI Data Evaluator: Video Recorder Evaluation
Remote AI Data Evaluator: Video Recorder Evaluation

AuraOne Human Data • United States

Remote
USD 28,000 - 41,000