Remote Psychology Assessment Architect for AI Content

Mercor

New York (NY)

On-site

USD 55,000 - 110,000

Part time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Mercor in the United States is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned two task types: Question Authoring and Question Verification, with asynchronous, fully remote collaboration and 10+ hours per

Qualifications

  • PhD/PsyD or doctoral candidate required or in progress with deep psychology theory.
  • Experience writing and reviewing psychology assessment content.
  • Ability to maintain high scholarly standards and clarity.

Responsibilities

  • Author original psychology questions for AI benchmarks.
  • Review and verify questions for accuracy and rigor.
  • Rate difficulty levels across domains (Medium/Hard/Expert).
  • Provide 1 correct answer and 9 plausible distractors and document changes.

Skills

Academic writing
Critical thinking
Research methodology
English proficiency

Education

PhD/ PsyD or doctoral candidate in Psychology
Master's degree considered

Job description

Mercor in the United States is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned two task types: Question Authoring and Question Verification, with asynchronous, fully remote collaboration and 10+ hours per

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Psychology Assessment Content Architect (PhD)
Remote Psychology Assessment Content Architect (PhD)

Mercor • New York (NY)

On-site
USD 42,000 - 64,000
Remote Psychometrics Expert for AI Assessment Content
Remote Psychometrics Expert for AI Assessment Content

Mercor • New York (NY)

Remote
USD 83,000 - 152,000
Remote Psychology Assessment Specialist for AI Training
Remote Psychology Assessment Specialist for AI Training

Mercor • Houston (TX)

On-site
USD 60,000 - 90,000
Fully remote
Asynchronous work
Remote Psychology Assessment Specialist (PhD)
Remote Psychology Assessment Specialist (PhD)

Mercor • New York (NY)

On-site
USD 90,000 - 120,000
Fully remote
Remote Psychology Assessment Specialist (PhD)
Remote Psychology Assessment Specialist (PhD)

Mercor • New York (NY)

On-site
USD 83,000 - 165,000
Fully remote
Flexible schedule
Remote AI Psychology Assessment Architect
Remote AI Psychology Assessment Architect

Obsidian • New York (NY)

On-site
USD 55,000 - 110,000
Remote AI Assessment Architect
Remote AI Assessment Architect

Mercor • New York (NY)

On-site
USD 55,000 - 124,000
Fully remote
Remote Psychometrics Expert for AI Assessment Content
Remote Psychometrics Expert for AI Assessment Content

Obsidian • New York (NY)

Remote
USD 69,000 - 124,000
Remote Psychology PhD Assessment Specialist - AI Content & QA
Remote Psychology PhD Assessment Specialist - AI Content & QA

Obsidian • New York (NY)

On-site
USD 83,000 - 131,000
Remote Psychology PhD: AI Assessment & Question Expert
Remote Psychology PhD: AI Assessment & Question Expert

Obsidian • Houston (TX)

On-site
USD 40,000 - 70,000