Remote Psychometrics Expert for AI Assessments

Mercor; Toronto; Remote; CAD 110,000 - 140,000; Full time

Job summary

Mercor is seeking expert psychologists to author and review rigorous academic assessment content for an AI research initiative. You will craft original, challenging psychology questions, rate their difficulty, and submit them for review.

You will be assigned one of two task types: question authoring or question verification, with a focus on deep conceptual understanding and precise problem statements. This is a fully remote, asynchronous engagement.

Qualifications

• PhD or doctoral candidate with strong knowledge of psychology theory and research.
• Experience writing and reviewing academic content.
• Ability to describe concepts clearly and concisely.
• Excellent written English.

Responsibilities

• Author high-quality psychology questions testing deep understanding.
• Review questions for accuracy, clarity, and rigor.
• Rate difficulty levels: Medium, Hard, or Expert.
• Provide 1 correct answer plus 9 plausible distractors.
• Document edits with justification for verification tasks.

Skills

Graduate-level psychology theory

Research methodology

Academic writing

Education

PhD in Psychology

Doctoral candidate in Psychology

Master's degree in Psychology or related field

Job description

Mercor is seeking expert psychologists to author and review rigorous academic assessment content for an AI research initiative. You will craft original, challenging psychology questions, rate their difficulty, and submit them for review.

You will be assigned one of two task types: question authoring or question verification, with a focus on deep conceptual understanding and precise problem statements. This is a fully remote, asynchronous engagement.