Remote Bilingual Japanese Psychologist (PhD) AI Evaluator

AuraOne, Inc.; United States; Remote; USD 45,000 - 75,000; Full time

Job summary

Responsibilities include comparing paired responses, selecting stronger answers with rationale, and documenting failure modes to guide rubric updates. Reliable remote availability of at least 10 hours per week is expected.

Qualifications

• Experience evaluating japanese generalist evaluation outputs or adjacent content.
• Ability to apply multi-page rubrics consistently across large batches.
• Clear written reasoning that cites rubric clauses.

Responsibilities

• Evaluate japanese generalist evaluation model outputs against a rubric and assign severity tags for Bilingual Japanese Psychologist (PhD) assignments.
• Compare paired responses and select the stronger answer with a written rationale.

Skills

Japanese language proficiency

Evaluation/annotation experience

Rubric-based review

Written rationale

Attention to detail

Async availability

Education

PhD in Psychology

Job description

Responsibilities include comparing paired responses, selecting stronger answers with rationale, and documenting failure modes to guide rubric updates. Reliable remote availability of at least 10 hours per week is expected.