Part-Time Medical AI Evaluator (MD/DO)

Mindrift; Minneota (MN); On-site; USD 107,000 - 179,000; Part time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. Projects are part-time and not permanent, with tasks that involve assessing vignette validity and clinical reasoning.

Contributors will score reasoning quality across independent reads, provide concise rationales, and participate in physician adjudication. Strong written English and current US licensure are required.

Qualifications

• MD or DO with active, unrestricted US medical license.
• Board certification or completed residency training with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning and knowledge of evidence-based guidelines.
• Experience in medical AI evaluation or medical annotation is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score reasoning quality and vignette accuracy across systems.
• Write concise rationales showing how vignette facts lead to answers.
• Participate in three blind reads with physician adjudication.

Skills

Strong written English

Clinical reasoning

Multi-system diagnostic experience

Part-time project readiness

Education

MD or DO

Board certification or residency training

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. Projects are part-time and not permanent, with tasks that involve assessing vignette validity and clinical reasoning.

Contributors will score reasoning quality across independent reads, provide concise rationales, and participate in physician adjudication. Strong written English and current US licensure are required.