Clinical AI Quality Evaluator — MD/DO (Part-Time)

Mercor; Houston (TX); On-site; USD 138,000 - 207,000; Part time

Job summary

Mercor is hiring experienced Medical Practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will assess model outputs for clinical accuracy, safety, and alignment with medical standards, score diagnoses and care recommendations, and write structured feedback on clarity and rigor.

The project runs for 6 weeks starting immediately. It is a part-time engagement (20+ hours per week) with the expectation that you are currently practicing, hold an active US

Qualifications

• MD or DO from an accredited medical school.
• Active, unrestricted US medical license required.
• Residency completed and currently practicing.
• 3+ years post-residency experience preferred.
• Experience across Primary Care, Internal Medicine, and hospital specialties.
• Located in the US.

Responsibilities

• Evaluate health AI model outputs for clinical accuracy, safety, and alignment with medical standards.
• Score diagnoses, case reasoning, and care recommendations against expert judgment.
• Write structured feedback on clarity, safety, and clinical rigor.
• Flag failure modes that could impact patient safety.
• Collaborate asynchronously with AI researchers to improve model performance.

Skills

MD/DO

Active US license

Clinical practice

Written communication

Primary care/internal medicine

Hospital-based specialties

Education

MD/DO

Residency completed

Job description

Mercor is hiring experienced Medical Practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will assess model outputs for clinical accuracy, safety, and alignment with medical standards, score diagnoses and care recommendations, and write structured feedback on clarity and rigor.

The project runs for 6 weeks starting immediately. It is a part-time engagement (20+ hours per week) with the expectation that you are currently practicing, hold an active US