Medical Evaluator - Clinical Expertise

Mercor; New York (NY); On-site; USD 138,000 - 207,000; Part time

Job summary

Mercor is seeking experienced Medical Practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will assess clinical accuracy, safety, and alignment with medical standards, and provide structured feedback.

Candidates must be currently practicing in the US, hold an active, unrestricted license, and have 3+ years post-residency experience in primary care, internal medicine, or hospital-based specialties.

Qualifications

• MD or DO from an accredited medical school.
• Active, unrestricted US medical license.
• Residency completed.
• Currently practicing and seeing patients.
• 3+ years of post-residency experience preferred.
• Practice in primary care, internal medicine, or hospital-based specialties (e.g., Primary Care, General Internal Medicine, Family Medicine, Emergency Medicine, Critical Care).
• Located in the US.

Responsibilities

• Evaluate AI model outputs for clinical accuracy, safety, and alignment with medical standards.
• Score diagnoses, case reasoning, and care recommendations against expert judgment.
• Write structured feedback on clarity, safety, and clinical rigor.
• Flag failure modes that compromise patient safety.
• Collaborate asynchronously with AI researchers to improve model performance.

Skills

Attention to detail

Written communication

Education

MD or DO from accredited medical school

Job description

Mercor is hiring experienced Medical Practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab.

Key Responsibilities

• Evaluate AI model outputs for clinical accuracy, safety, and alignment with medical standards
• Score diagnoses, case reasoning, and care recommendations against expert judgment
• Write structured feedback on clarity, safety, and clinical rigor
• Flag failure modes that compromise patient safety
• Collaborate asynchronously with AI researchers to improve model performance

Required Qualifications

• MD or DO from an accredited medical school
• Active, unrestricted US medical license
• Residency complete
• Currently practicing and seeing patients
• 3+ years of post-residency experience in your current role strongly preferred
• Practice in primary care, internal medicine, and hospital-based specialties (Primary Care, General Internal Medicine, Family Medicine, Emergency Medicine, Critical Care)
• Sharp attention to detail and clear written communication
• Located in the US

Project Timeline

• Start Date: Immediate
• Duration: 6 weeks
• Commitment: Part-time, 20+ hours per week