Remote AI Evaluation Scientist — Derivation & Reproduction

AuraOne, Inc.; United States; À distance; USD 83 000 - 124 000; Plein temps

Avantages offerts par ce poste

Remote work (US-eligible)

Contractor role

Flexible hours

Résumé du poste

AuraOne, Inc. seeks a Competitive Data Scientist — AI Evaluation (Remote) to review AI outputs, reproduce key derivations, and document correct methods for training data pipelines.

You will work as a contractor with US-eligibility, committing to at least 10 hours per week, and collaborate asynchronously with the modeling team to ensure rigorous evaluation and clear reasoning.

This role emphasizes precise rubric-based assessment, citation checks, and maintaining quality scores across batches.

Qualifications

• Graduate-level training or equivalent applied experience in research science or a closely related field.
• Hands-on experience publishing, teaching, or advising on the topic at a professional level.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that cites methods, papers, or worked examples.
• Reliable async availability for at least 10 hours per week.

Responsabilités

• Review AI outputs against current research science methods, conventions, and prior work for Competitive Data Scientist — AI Evaluation (Remote) assignments.
• Reproduce or sanity-check key derivations, calculations, or experimental claims.
• Flag dimensional, methodological, and citation errors with structured severity tags.
• Capture the corrected reasoning or worked example so the modeling team can train on it.
• Adjudicate disputed answers against textbooks, papers, or community standards.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Connaissances

Scientific reasoning

Method validation

Citation review

Quantitative analysis

Research science

Formation

Graduate degree in a related field

Description du poste

AuraOne, Inc. seeks a Competitive Data Scientist — AI Evaluation (Remote) to review AI outputs, reproduce key derivations, and document correct methods for training data pipelines.

You will work as a contractor with US-eligibility, committing to at least 10 hours per week, and collaborate asynchronously with the modeling team to ensure rigorous evaluation and clear reasoning.

This role emphasizes precise rubric-based assessment, citation checks, and maintaining quality scores across batches.