Remote AI Research Evaluation Specialist (Contractor)

AuraOne, Inc.; United States; À distance; USD 55 000 - 96 000; Plein temps

Résumé du poste

AuraOne, Inc. is seeking a Research Evaluation Specialist (PhD, Masters, Researcher, or Professor) to remotely review AI outputs across research evaluation tasks, verify derivations, reproduce results, and document methods for training data.

The role emphasizes independent work, rigorous reasoning, and adherence to rubrics. You will grade and adjudicate outputs, maintain quality scores, and support the modeling team with corrected reasoning.

Qualifications

• Graduate-level training or equivalent experience in research evaluation or a related field.
• Experience publishing, teaching, or advising on the topic at a professional level.
• Ability to apply rubrics consistently and cite methods in written reasoning.

Responsabilités

• Review AI outputs against established research evaluation methods.
• Reproduce key derivations and check calculations.
• Flag dimensional, methodological, and citation errors with severity tags.
• Document corrected reasoning for model training.
• Adjudicate disputed answers using textbooks or papers.
• Maintain inter-rater calibration and reviewer quality scores.

Connaissances

Scientific reasoning

Method validation

Citation review

Quantitative analysis

Research Evaluation research review

AI model evaluation

Formation

Graduate-level training in research evaluation

Description du poste

AuraOne, Inc. is seeking a Research Evaluation Specialist (PhD, Masters, Researcher, or Professor) to remotely review AI outputs across research evaluation tasks, verify derivations, reproduce results, and document methods for training data.

The role emphasizes independent work, rigorous reasoning, and adherence to rubrics. You will grade and adjudicate outputs, maintain quality scores, and support the modeling team with corrected reasoning.