Physician Reviewer (MD/DO) for AI Evaluation Projects

Mindrift; Minneapolis (MN); Remote; USD 114,000 - 162,000; Part time

Job summary

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program focused on testing and improving AI systems. Duties include rating reasoning quality across multiple body systems and producing brief rationales.

Projects are part-time and compensation is task-based, up to $100/hr, with work distributed across independent reads and adjudication. Requires MD/DO, active US license, and strong English writing.

Qualifications

• MD or DO required with active US medical license.
• Board certification or residency training preferred.
• Strong clinical reasoning across multiple systems.
• Experience in medical AI evaluation is a plus.
• Excellent written English (C1+) required.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score clinical reasoning quality: vignette accuracy, completeness, trap quality, and answer correctness.
• Write concise rationales explaining reasoning chains.
• Participate in three independent blind reads followed by physician adjudication.

Skills

Clinical reasoning

Medical AI evaluation experience

Written English

Multi-system diagnostic experience

Guideline application

Education

MD or DO

Active US medical license

Board certification or residency training

Job description

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program focused on testing and improving AI systems. Duties include rating reasoning quality across multiple body systems and producing brief rationales.

Projects are part-time and compensation is task-based, up to $100/hr, with work distributed across independent reads and adjudication. Requires MD/DO, active US license, and strong English writing.