MD/DO Clinical AI Evaluator (Part-Time)

Mindrift; Idaho; Remote; USD 83,000 - 179,000; Part time

Benefits offered by this job

Flexible hours

Part-time projects

Remote-friendly

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Primary focus in general and internal medicine with tasks spanning multiple organ systems.

You will assess vignette accuracy, gradeability, and rationale quality, then provide concise rationales across three blind reads and adjudication. This opportunity is designed for part-time, non-permanent projects.

Qualifications

• MD or DO degree and an active, unrestricted US medical license.
• Board certification or recent residency with direct patient care.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and application of guidelines.
• Experience in medical AI evaluation or exam-question review is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors.
• Score reasoning quality: vignette accuracy, completeness, trap quality and deduced answer.
• Check reasoning chains reach conclusions from vignette facts; write short rationales.
• Participate in three blind reads followed by physician adjudication.

Skills

MD/DO

Active US license

Clinical reasoning

Medical AI evaluation

Written English

Education

MD or DO degree

Tools

Annotation tools

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Primary focus in general and internal medicine with tasks spanning multiple organ systems.

You will assess vignette accuracy, gradeability, and rationale quality, then provide concise rationales across three blind reads and adjudication. This opportunity is designed for part-time, non-permanent projects.