Remote Psychology PhD: AI Assessment & Question Expert

Obsidian

Houston (TX)

On-site

USD 40,000 - 70,000

Part time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Obsidian is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will craft and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, with responsibilities that include rating difficulty, providing 1 correct answer

Qualifications

  • PhD, PsyD, or doctoral candidate in Psychology or closely related field.
  • Strong command of graduate-level psychological theory, research methodology, and empirical literature.
  • Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

  • Author original psychology questions that test deep conceptual understanding, not surface-level recall.
  • Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement.
  • Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
  • Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
  • Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories).
  • For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Skills

Academic writing
Psychology knowledge
Question design
Critical thinking
English clarity

Education

PhD/ PsyD or doctoral candidate in Psychology
Master's degree (exceptional depth)

Job description

Obsidian is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will craft and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, with responsibilities that include rating difficulty, providing 1 correct answer

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote Psychology PhD Assessment Specialist - AI Content & QA
Remote Psychology PhD Assessment Specialist - AI Content & QA

Obsidian • New York (NY)

On-site
USD 83,000 - 131,000
Remote Psychometrics Expert for AI Assessment Content
Remote Psychometrics Expert for AI Assessment Content

Obsidian • New York (NY)

Remote
USD 69,000 - 124,000
Remote AI Psychology Assessment Architect
Remote AI Psychology Assessment Architect

Obsidian • New York (NY)

On-site
USD 55,000 - 110,000
Remote Psychology Assessment Specialist for AI Training
Remote Psychology Assessment Specialist for AI Training

Mercor • Houston (TX)

On-site
USD 60,000 - 90,000
Fully remote
Asynchronous work
Remote Psychology Assessment Specialist (PhD)
Remote Psychology Assessment Specialist (PhD)

Mercor • New York (NY)

On-site
USD 90,000 - 120,000
Fully remote
Remote Psychometrics Expert for AI Assessment Content
Remote Psychometrics Expert for AI Assessment Content

Mercor • New York (NY)

Remote
USD 83,000 - 152,000
Remote AI Engineering Assessment Author (PhD)
Remote AI Engineering Assessment Author (PhD)

Obsidian • San Francisco (CA)

On-site
USD 83,000 - 124,000
Psychology PhD - Assessment Specialist - AI Trainer
Psychology PhD - Assessment Specialist - AI Trainer

Mercor • New York (NY)

On-site
USD 90,000 - 120,000
Fully remote
Remote Psychology Assessment Content Architect (PhD)
Remote Psychology Assessment Content Architect (PhD)

Mercor • New York (NY)

On-site
USD 42,000 - 64,000
Psychology PhD - Assessment Specialist
Psychology PhD - Assessment Specialist

Mercor • New York (NY)

On-site
USD 83,000 - 165,000
Fully remote
Flexible schedule