Part-Time Physician AI Evaluation Reviewer (MD/DO)

Mindrift; Jacksonville (FL); Remote; USD 83,000 - 138,000; Part time

Job summary

Mindrift connects physicians with project-based AI evaluation programs, focusing on testing, evaluating, and improving AI systems. We are seeking US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program in general internal and primary care medicine.

Contributors may perform tasks such as scoring reasoning quality, checking stepwise logic, and writing concise rationales.

Qualifications

• MD or DO required and active US license.
• Board certification or recent residency with direct patient care preferred.
• Broad multi-system diagnostic and treatment experience across internal, family, emergency or hospital medicine.
• Strong clinical reasoning and knowledge of evidence-based guidelines.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers and distractors.
• Score reasoning quality: vignette accuracy, completeness, trap quality, and answer correctness.
• Assess whether reasoning reaches the answer from vignette facts and write brief rationales.
• Work through three independent blind reads with physician adjudication.

Skills

Clinical reasoning

Multi-system experience

Written English (C1+)

Education

MD or DO

Job description

Mindrift connects physicians with project-based AI evaluation programs, focusing on testing, evaluating, and improving AI systems. We are seeking US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program in general internal and primary care medicine.

Contributors may perform tasks such as scoring reasoning quality, checking stepwise logic, and writing concise rationales.