US-based Physician AI Evaluation Reviewer (MD/DO) - Part-Time

Mindrift; Yorktown (VA); Sur place; USD 107 000 - 179 000; Temps partiel

Résumé du poste

Mindrift invites US-based physicians (MD/DO) to participate in a medical AI evaluation program evaluating EHR vignettes across multiple specialties. This is a part-time, project-based opportunity with tasks paid per accepted submission.

Contributors will review vignette questions, score reasoning quality, and write concise rationales. Three blind reads plus adjudication ensure robust evaluation to improve AI tools used in clinical practice.

Qualifications

• MD or DO with active US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad diagnostic and treatment experience across internal, family, emergency, or hospital medicine.
• Strong clinical reasoning and application of evidence-based guidelines.
• Experience in medical AI evaluation or QA is a plus.
• Excellent written English.

Responsabilités

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors across multiple systems.
• Score the clinical reasoning quality of benchmark items and assess vignette completeness and accuracy.
• Check reasoning traces and write short rationales for each item.
• Participate in three independent blind reads and physician adjudication.
• Contribute to improving AI evaluation tools and related processes.

Connaissances

Clinical reasoning

English proficiency

Multi-system experience

AI evaluation experience

Formation

MD/DO medical degree

Description du poste

Mindrift invites US-based physicians (MD/DO) to participate in a medical AI evaluation program evaluating EHR vignettes across multiple specialties. This is a part-time, project-based opportunity with tasks paid per accepted submission.

Contributors will review vignette questions, score reasoning quality, and write concise rationales. Three blind reads plus adjudication ensure robust evaluation to improve AI tools used in clinical practice.