Psychometrics Expert: AI Assessment Creator (Remote)

Mercor; Sydney; Remote; AUD 83,000 - 165,000; Part time

Benefits offered by this job

Fully remote

Job summary

Mercor is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains and help establish gold-standard benchmarks for advancing AI capabilities.

This fully remote, asynchronous role requires 10+ hours per week. Responsibilities include crafting original questions, rating difficulty, providing 1 correct answer with 9 plausible distractors, and

Qualifications

• PhD or doctoral candidate in Psychology or closely related field.
• Master's degree considered for exceptional depth in a subdomain.
• Strong command of graduate-level psychological theory and research methodology.

Responsibilities

• Author original psychology questions that test deep conceptual understanding.
• Rate each question's difficulty: Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions with clear reasoning in markdown format.
• Supply 1–5 academic references per question.

Skills

Academic writing

Critical thinking

Psychology theory

English proficiency

Education

PhD in Psychology

Master's degree considered for exceptional depth

Job description

Mercor is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains and help establish gold-standard benchmarks for advancing AI capabilities.

This fully remote, asynchronous role requires 10+ hours per week. Responsibilities include crafting original questions, rating difficulty, providing 1 correct answer with 9 plausible distractors, and