Remote Causal Reasoning Evaluation Specialist

AuraOne; United States; On-site; USD 82,656 - 123,984; Part time

Job summary

AuraOne is seeking a Causal Reasoning Model Evaluation Specialist for remote contractor work in the US. Review AI outputs, reproduce key derivations, check calculations, and document the correct method so the modeling team can train on it.

You will apply multi-page rubrics, flag methodological errors with structured notes, and maintain inter-rater calibration scores while contributing to ongoing evaluation workflows. This role offers flexible scheduling and requires at least 10 hours per week.

Qualifications

• Graduate-level training or equivalent applied experience in causal reasoning model evaluation research review or a closely related field.
• Hands-on experience publishing, teaching, or advising on the topic at a professional level.
• Clear written reasoning that cites methods, papers, or worked examples.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current causal reasoning model evaluation research review methods, conventions, and prior work for Causal Reasoning Model Evaluation Specialist assignments.
• Reproduce or sanity-check key derivations, calculations, or experimental claims.
• Flag dimensional, methodological, and citation errors with structured severity tags.
• Capture the corrected reasoning or worked example so the modeling team can train on it.
• Adjudicate disputed answers against textbooks, papers, or community standards.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Scientific reasoning

Method validation

Citation review

Quantitative analysis

Causal evaluation

Frontier evaluation

Rubric calibration

Failure analysis

Causal

Reasoning

Job description

AuraOne is seeking a Causal Reasoning Model Evaluation Specialist for remote contractor work in the US. Review AI outputs, reproduce key derivations, check calculations, and document the correct method so the modeling team can train on it.

You will apply multi-page rubrics, flag methodological errors with structured notes, and maintain inter-rater calibration scores while contributing to ongoing evaluation workflows. This role offers flexible scheduling and requires at least 10 hours per week.