Clinical AI Evaluation Specialist (MD/DO) – Part-Time

Mindrift; Idaho; Remote; USD 80,000 - 113,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies. We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program, focusing on internal and general medicine. Expect multi-system tasks, scoring, and brief rationales across diagnoses and treatments.

Projects are part-time and non-permanent, with compensation paid per accepted task. Rates can reach up to $70/hr, reflecting qualification tier and task efficiency.

Qualifications

• MD or DO with an active US medical license.
• Board certification or residency with recent direct patient care (attending-level preferred).
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis and management, evidence-based guidelines.
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with a question, proposed answer, and distractor.
• Score the clinical reasoning quality: vignette accuracy, completeness, and trap quality.
• Check whether the reasoning chain reaches the answer from vignette facts; write short rationales.
• Work within three blind reads followed by physician adjudication; handle real clinical complexity.

Skills

MD/DO

Active US license

Clinical reasoning

Strong written English

Education

MD/DO degree

US medical license verified

Tools

Medical AI evaluation

Clinical QA experience

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies. We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program, focusing on internal and general medicine. Expect multi-system tasks, scoring, and brief rationales across diagnoses and treatments.

Projects are part-time and non-permanent, with compensation paid per accepted task. Rates can reach up to $70/hr, reflecting qualification tier and task efficiency.