AI Assessment Psychologist — Remote, Part‑Time

Mercor; Sydney; On-site; AUD 90,000 - 130,000; Full time

Job summary

Mercor seeks expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: question authoring or question verification, with responsibilities including creating original questions, rating difficulty, and

Qualifications

• Writes and reviews high-quality academic assessment content.
• Calls for clear, unambiguous problem statements with all necessary information included.
• Rates each question's difficulty: Medium, Hard or Expert.
• Provides 1 correct answer and 9 plausible options.
• Writes step-by-step Chain-of-Thought solutions in markdown.
• Requires 1–5 academic references per question.
• For verification tasks: flags clarity, completeness, precision, solvability and justifies edits.

Responsibilities

• Author original psychology questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement.
• Rate each question's difficulty: Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
• Supply 1–5 academic references per question.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify edits.

Education

PhD in Psychology

Doctoral candidate in Psychology

Master's degree considered for exceptional depth

Job description

Mercor seeks expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: question authoring or question verification, with responsibilities including creating original questions, rating difficulty, and