Remote Psychometrics Expert for AI Assessment Content

Mercor; New York (NY); Remote; USD 83,000 - 152,000; Full time

Job summary

Mercor seeks expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks to advance AI capabilities.

You will be assigned two task types: Question Authoring and Question Verification, both conducted remotely with asynchronous collaboration.

Qualifications

• PhD or doctoral candidate in psychology with strong writing and analytical skills.
• Excellent command of graduate-level psychological theory and research methods.
• Excellent written English and ability to express complex ideas clearly.

Responsibilities

• Author original psychology questions with deep conceptual testing.
• Rate difficulty for each question as Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible distractors.
• Write step-by-step Chain-of-Thought solutions with concise reasoning.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks: flag clarity, completeness, precision, solvability; justify edits.

Skills

Psychology expertise

Academic writing

Quality review

Education

PhD in Psychology

Doctoral candidate in Psychology

Job description

Mercor seeks expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks to advance AI capabilities.

You will be assigned two task types: Question Authoring and Question Verification, both conducted remotely with asynchronous collaboration.