Remote Research Evaluation Scientist (Contractor)

AuraOne, Inc.; United States; Remote; USD 55,000 - 110,000; Full time

Benefits offered by this job

PhD/academic experience preferred

Experience reviewing AI tools

Multilingual fluency (non-English)

Job summary

AuraOne, Inc. is seeking a Research Evaluation Specialist (PhD or Masters / Researcher / Professor) to remotely review AI outputs across evaluation methods and workflows. You will reproduce derivations, flag errors, and document methods to guide the modeling team.

Responsibilities include grading, adjudicating disputes using textbooks or papers, and maintaining inter-rater calibration scores. This role is a contractor with hourly compensation determined after interview.

Qualifications

• Graduate-level training or equivalent applied experience in research evaluation or related field.
• Hands-on experience publishing, teaching, or advising on the topic at a professional level.
• Ability to apply multi-page rubrics consistently across long batches.

Responsibilities

• Review AI outputs against research evaluation methods and prior work.
• Reproduce or sanity-check key derivations and claims.
• Flag dimensional or methodological errors with structured severity tags.
• Capture corrected reasoning or worked examples for model training.
• Adjudicate disputed answers against textbooks or papers.
• Maintain reviewer quality scores in calibration cycles.

Skills

Scientific reasoning

Method validation

Citation review

Quantitative analysis

AI model evaluation

Research evaluation

Education

Graduate degree in related field

Publications/teaching experience

Job description

AuraOne, Inc. is seeking a Research Evaluation Specialist (PhD or Masters / Researcher / Professor) to remotely review AI outputs across evaluation methods and workflows. You will reproduce derivations, flag errors, and document methods to guide the modeling team.

Responsibilities include grading, adjudicating disputes using textbooks or papers, and maintaining inter-rater calibration scores. This role is a contractor with hourly compensation determined after interview.