Remote Data Scientist: Research QA & Reproducibility

AuraOne

United States

On-site

USD 81,278 - 157,046

Full time

14 days+

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

AuraOne seeks a Data Scientist to remotely review AI outputs across research science reasoning and workflows. Reviewers grade derivations, reproduce key results, and document the correct method for training the modeling team.

Responsibilities include reproducing derivations, flagging errors, and maintaining inter-rater calibration scores while applying multiline rubric criteria. This is a contractor position with flexible scheduling and remote work within the US.

Qualifications

Graduate-level training or equivalent applied experience in research science.
Experience publishing, teaching, or advising on the topic at a professional level.
Comfort applying multi-page rubrics consistently across long batches.
Clear written reasoning that cites methods, papers, or worked examples.
Reliable async availability for at least 10 hours per week.

Responsibilities

Review AI outputs against current research science methods, conventions, and prior work for Data Scientist assignments.
Reproduce or sanity-check key derivations, calculations, or experimental claims.
Flag dimensional, methodological, and citation errors with structured severity tags.
Capture the corrected reasoning or worked example so the modeling team can train on it.
Adjudicate disputed answers against textbooks, papers, or community standards.
Maintain reviewer-quality scores in inter-rater calibration cycles.