Remote Physician AI Evaluation Reviewer (MD/DO)

Mindrift; Anchorage (AK); Remote; USD 131,000 - 145,000; Part time

Benefits offered by this job

$50 onboarding reward

Job summary

Mindrift is seeking actively practicing physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus, with a flexible, project-based workload that fits around clinical practice.

You will review vignettes, score reasoning quality, check whether the reasoning chain follows from the facts, and write concise rationales.

Qualifications

• Active, unrestricted US medical license (verified at onboarding).
• Board certification or residency with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning and guideline application.
• Experience in medical AI evaluation, clinical content, or medical annotation/QA is a plus.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions and distractors across multiple medical domains.
• Score vignette accuracy, completeness, whether the vignette reveals the answer, and trap quality.
• Check whether the reasoning chain follows from vignette facts and write short rationales.
• Work within three blind reads, followed by physician adjudication.

Skills

Active US medical license

Board certification or residency

Broad multi-system experience

Clinical reasoning

Written English

Medical AI evaluation experience

Education

MD or DO

Job description

Mindrift is seeking actively practicing physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus, with a flexible, project-based workload that fits around clinical practice.

You will review vignettes, score reasoning quality, check whether the reasoning chain follows from the facts, and write concise rationales.