Remote Psychometrics Expert for AI Assessment Content

Obsidian; New York (NY); Remote; USD 69,000 - 124,000; Part time

Job summary

Obsidian seeks expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous MC questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, enabling you to contribute to courseware design and quality control.

Responsibilities

• Author original psychology questions that test deep conceptual understanding
• Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement
• Rate each question's difficulty: Medium, Hard, or Expert
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives
• Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format
• Supply 1–5 academic references per question

Job description

Obsidian seeks expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous MC questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, enabling you to contribute to courseware design and quality control.