Part-Time Physician for Medical AI Evaluation (MD/DO)

Mindrift; Orlando (FL); On-site; USD 83,000 - 138,000; Full time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. This project-based role focuses on testing, evaluating, and improving AI systems. You will score reasoning quality, assess vignette accuracy, and write concise rationales.

Contributors will work within three independent blind reads, followed by physician adjudication. A current US medical license, board certification or residency, and strong English skills are required.

Qualifications

• Medical degree (MD or DO) and an active, unrestricted US medical license
• Board certification or completed residency training, with recent direct patient care
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA
• Strong written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across multiple medical domains
• Score the clinical reasoning quality of benchmark items: vignette accuracy, completeness, and trap quality
• Check whether the reasoning chain reaches the answer from vignette facts, and write short rationales
• Work within three independent blind reads, followed by physician adjudication

Skills

Clinical reasoning

Medical AI evaluation experience

English proficiency

Multisystem medicine experience

Education

MD or DO

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. This project-based role focuses on testing, evaluating, and improving AI systems. You will score reasoning quality, assess vignette accuracy, and write concise rationales.

Contributors will work within three independent blind reads, followed by physician adjudication. A current US medical license, board certification or residency, and strong English skills are required.