AI Medical Evaluator (MD/DO) – Part-Time, Project-Based

Mindrift; Lake Michigan Beach (MI); Remote; USD 148,000 - 210,000; Part time

Job summary

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. You will assess vignette accuracy, scoring, and reasoning quality across multiple organ systems, writing concise rationales and ensuring traceable reasoning from facts to conclusions.

Projects are part-time and not permanent, with compensation per accepted task. Prior AI evaluation experience is a plus; strong English writing is essential.

Qualifications

• Must have MD or DO with active US medical license.
• Board certification or completed residency training with recent direct patient care.
• Strong written English (C1+) required.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions and proposed answers.
• Score clinical reasoning quality of benchmark items: vignette accuracy, completeness, and trap quality.
• Write short rationales and check reasoning chains from vignette facts to answers.
• Participate in three blind reads followed by physician adjudication.

Skills

English proficiency

Clinical reasoning

Education

MD or DO

Active US medical license

Board certification or residency with recent direct patient care

Job description

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. You will assess vignette accuracy, scoring, and reasoning quality across multiple organ systems, writing concise rationales and ensuring traceable reasoning from facts to conclusions.

Projects are part-time and not permanent, with compensation per accepted task. Prior AI evaluation experience is a plus; strong English writing is essential.