Clinical AI Evaluator & Medical Expert

Mercor; New York (NY); On-site; USD 138,000 - 207,000; Part time

Job summary

Mercor is seeking experienced Medical Practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will assess clinical accuracy, safety, and alignment with medical standards, and provide structured feedback.

Candidates must be currently practicing in the US, hold an active, unrestricted license, and have 3+ years post-residency experience in primary care, internal medicine, or hospital-based specialties.

Qualifications

• MD or DO from an accredited medical school.
• Active, unrestricted US medical license.
• Residency completed.
• Currently practicing and seeing patients.
• 3+ years of post-residency experience preferred.
• Practice in primary care, internal medicine, or hospital-based specialties (e.g., Primary Care, General Internal Medicine, Family Medicine, Emergency Medicine, Critical Care).
• Located in the US.

Responsibilities

• Evaluate AI model outputs for clinical accuracy, safety, and alignment with medical standards.
• Score diagnoses, case reasoning, and care recommendations against expert judgment.
• Write structured feedback on clarity, safety, and clinical rigor.
• Flag failure modes that compromise patient safety.
• Collaborate asynchronously with AI researchers to improve model performance.

Skills

Attention to detail

Written communication

Education

MD or DO from accredited medical school

Job description

Mercor is seeking experienced Medical Practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will assess clinical accuracy, safety, and alignment with medical standards, and provide structured feedback.

Candidates must be currently practicing in the US, hold an active, unrestricted license, and have 3+ years post-residency experience in primary care, internal medicine, or hospital-based specialties.