Remote Psychiatry AI Evaluation Specialist

Mercor; New York (NY); Remote; USD 96,000 - 152,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Job summary

Mercor is hiring board-certified psychiatrists (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in psychiatry.

This remote, hourly, part-time role starts immediately. Responsibilities include evaluating AI answers for accuracy, safety and alignment with standards, comparing responses, and writing structured rationales with a focus on rigor and clarity.

Qualifications

• MD or DO from an accredited medical school.
• Board certified in ABPN Psychiatry.
• Active, unrestricted US medical license.
• Residency completed; fellowship if required for the specialty.
• Currently practicing in the US with at least 1 year of independent practice.
• 3+ years post-training experience preferred.
• Clear written communication and close attention to detail.

Responsibilities

• Evaluate AI answers to psychiatry questions for accuracy and safety.
• Check AI responses against patient charts and judge which is stronger.
• Write structured rationales on clinical rigor, completeness and clarity.
• Flag errors that could compromise patient safety.

Skills

ABPN Psychiatry

Active US license

Independent practice

Clear written communication

Attention to detail

Education

MD or DO from accredited medical school

Job description

Mercor is hiring board-certified psychiatrists (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in psychiatry.

This remote, hourly, part-time role starts immediately. Responsibilities include evaluating AI answers for accuracy, safety and alignment with standards, comparing responses, and writing structured rationales with a focus on rigor and clarity.