Physician AI Model Evaluator (Part-Time, US)

HumanitApp; United States; On-site; USD 170,000 - 243,000; Part time

Job summary

Mercor is seeking experienced Medical Practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will assess model outputs across diagnosis, clinical reasoning, and care workflows, with a focus on safety, accuracy, and alignment to medical standards.

The project runs for 6 weeks with a start date of immediate, offering part-time, 20+ hours per week and compensation at $150 per hour.

Qualifications

• MD or DO from an accredited medical school.
• Active, unrestricted US medical license.
• Residency completed.
• Currently practicing and seeing patients.
• 3+ years post-residency experience strongly preferred.
• Practice in primary care, internal medicine, or hospital-based specialties.

Responsibilities

• Evaluate AI model outputs for clinical accuracy, safety, and alignment with medical standards.
• Score diagnoses, case reasoning, and care recommendations against expert judgment.
• Write structured feedback on clarity, safety, and clinical rigor.
• Flag failure modes that compromise patient safety.
• Collaborate asynchronously with AI researchers to improve model performance.

Skills

Clinical evaluation

Clear written communication

Education

MD/DO from accredited medical school

Residency completed

Job description

Mercor is seeking experienced Medical Practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will assess model outputs across diagnosis, clinical reasoning, and care workflows, with a focus on safety, accuracy, and alignment to medical standards.

The project runs for 6 weeks with a start date of immediate, offering part-time, 20+ hours per week and compensation at $150 per hour.