Psychology PhD - Assessment Specialist

Mercor

Mumbai

On-site

INR 250,000 - 380,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Mercor is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, with duties including rating difficulty and ensuring problems are self-contained.

Qualifications

  • Strong command of graduate-level psychology theory, research methods, and literature.

Responsibilities

  • Author original psychology questions testing deep conceptual understanding.
  • Rate question difficulty: Medium, Hard, Expert.
  • Provide 1 correct answer and 9 plausible alternatives.
  • Write step-by-step Chain-of-Thought solutions in markdown format.
  • Supply 1–5 academic references per question.

Skills

Graduate-level psychology knowledge
Research methodology
Empirical literature familiarity

Education

PhD / PsyD / doctoral candidate
Master's degree considered for exceptional depth

Job description

Role Overview

We are seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types:

  • Question Authoring - Create original, challenging multiple-choice questions in your area of psychology expertise, rate their difficulty, and submit them for review.

  • Question Verification - Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made.

Psychology Domains Covered

Neuromorphic Engineering, Human Factors and Engineering Psychology, Consumer and Market Psychology, Psychometrics, Digital Health, Psychedelic-assisted Therapy.

Key Responsibilities
  • Author original psychology questions that test deep conceptual understanding, not surface-level recall

  • Ensure questions are unambiguous, self-contained, and precisely defined - all necessary information must be in the problem statement

  • Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above)

  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers

  • Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format

  • Supply 1-5 academic references per question from reputable sources (peer-reviewed journals, university repositories)

  • For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made

Ideal Qualifications
  • PhD, PsyD, or doctoral candidate in Psychology or a closely related field

  • Master's degree considered for candidates with exceptional depth in a specific subdomain

  • Strong command of graduate-level psychological theory, research methodology, and empirical literature

  • Clinical licensure or research publications in psychology is a strong plus

  • Excellent written English and ability to express complex ideas clearly and concisely

More About the Opportunity
  • Expected commitment: 10+ hours/week

  • Asynchronous, fully remote work

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Assessment Specialist - PhD
AI Assessment Specialist - PhD

Mercor • Mumbai

On-site
INR 6,686,000 - 10,506,000
Psychology QA Lead - Remote
Psychology QA Lead - Remote

YO IT Consulting • Chennai District

On-site
INR 800,000 - 1,200,000
Engineering PhD - Benchmark Specialist
Engineering PhD - Benchmark Specialist

Mercor • Mumbai

On-site
INR 500,000 - 1,000,000
Academic Advisor
Academic Advisor

Innodata Inc. • Delhi

On-site
INR 1,800,000 - 3,200,000
Senior Psychologist Psychometrics & Product Research
Senior Psychologist Psychometrics & Product Research

Snetaj It Solutions • Dadri

Hybrid
INR 1,200,000 - 2,400,000
Research Scientist u2013 AI & Mental Health
Research Scientist u2013 AI & Mental Health

Amrita Vishwa Vidyapeetham • Faridabad District

On-site
INR 1,500,000 - 2,100,000
SME Psychology K12 (Freelancer)
SME Psychology K12 (Freelancer)

Soul Ai • Bengaluru

On-site
INR 600,000 - 900,000
Computer Science Research Expert | Remote
Computer Science Research Expert | Remote

Crossing Hurdles • India

On-site
INR 240,198 - 287,710
Evaluation Scenario Writer - QA
Evaluation Scenario Writer - QA

Mindrift • India

Remote
Flexible freelance project
Up to $15/hour based on experience
Gaining valuable AI project experience
AI Agent Evaluation Analyst (Freelance)
AI Agent Evaluation Analyst (Freelance)

Mindrift • Maharashtra

Remote
Flexible schedule
Competitive pay up to $12/hour
Gain experience in advanced AI projects