Remote Critical Care MD — AI Model Evaluator (Part-Time)

Mercor; New York (NY); Remote; USD 165,000 - 248,000; Part time

Job summary

Mercor is hiring board-certified critical care physicians (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in critical care.

Key responsibilities include evaluating AI answers for accuracy and safety, comparing responses against patient charts, and writing structured rationales while flagging potential safety issues.

Qualifications

• MD or DO degree from an accredited medical school.
• Board certified in Critical Care Medicine (ABIM, ABA, ABEM or ABS).
• Active, unrestricted US medical license.
• Residency completed, plus fellowship where your specialty requires one.

Responsibilities

• Evaluate AI answers to critical care questions for clinical accuracy, safety and alignment with current standards of care.
• Check each answer against the patient chart and decide which of two responses is stronger.
• Write structured rationales on clinical rigor, completeness and clarity.
• Flag errors that could compromise patient safety.

Skills

Written communication

Attention to detail

US clinical practice

Education

MD/DO degree

Board-certified in Critical Care

Active US medical license

Residency + fellowship

Job description

Mercor is hiring board-certified critical care physicians (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in critical care.

Key responsibilities include evaluating AI answers for accuracy and safety, comparing responses against patient charts, and writing structured rationales while flagging potential safety issues.