Remote Critical Care Physician – AI Model Evaluator

Mercor; New York (NY); Remote; USD 138,000 - 276,000; Full time

Job summary

Mercor is hiring board-certified critical care physicians (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in critical care.

Responsibilities include evaluating AI answers for accuracy, safety and standards of care, checking against charts, selecting the stronger response, and writing structured rationales while flagging potential safety issues.

Qualifications

• MD or DO from an accredited medical school.
• Board certified in Critical Care Medicine (ABIM, ABA, ABEM or ABS) through an ABMS member board or the AOA.
• Active, unrestricted US medical license.
• Residency complete, plus fellowship where your specialty requires one.
• Currently practicing and seeing patients in the US, with at least 1 year of independent practice after training.
• 3+ years of post-training experience strongly preferred.
• Clear written communication and close attention to detail.

Responsibilities

• Evaluate AI answers to critical care questions for clinical accuracy, safety and alignment with current standards of care
• Check each answer against the patient chart and decide which of two responses is stronger
• Write structured rationales on clinical rigor, completeness and clarity
• Flag errors that could compromise patient safety

Skills

CCM board cert

US medical license

Independent practice

Clinical documentation

Attention to detail

Clear written comm

Education

MD/DO degree

Job description

Mercor is hiring board-certified critical care physicians (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in critical care.

Responsibilities include evaluating AI answers for accuracy, safety and standards of care, checking against charts, selecting the stronger response, and writing structured rationales while flagging potential safety issues.