Remote AI Psychology Assessment Architect

Obsidian; New York (NY); On-site; USD 55,000 - 110,000; Full time

Job summary

Obsidian is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, with remote, asynchronous collaboration and a commitment of 10+ hours per week.

Qualifications

• Doctoral-level psychology knowledge and research methodology
• Excellent written English and ability to express complex ideas clearly and concisely
• Ability to author and verify rigorous assessment content for AI research initiatives
• Capacity to rate question difficulty (Medium/Hard/Expert) and provide justifications
• Experience with scholarly references and documentation of changes for verifications

Responsibilities

• Author original psychology questions that test deep conceptual understanding
• Ensure questions are unambiguous, self-contained, and precisely defined
• Rate each question's difficulty: Medium, Hard, Expert
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives
• Write step-by-step Chain-of-Thought solutions with clear reasoning
• Supply 1–5 academic references per question
• Flag issues with clarity, completeness, precision, solvability and justify edits

Education

PhD in Psychology

PsyD or Doctoral candidate in Psychology

Master's degree (exceptional depth in subdomain)

Job description

Obsidian is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, with remote, asynchronous collaboration and a commitment of 10+ hours per week.