Physician Reviewer, AI Medical Evaluation (MD/DO)

Mindrift; West Virginia; Remote; USD 34,000 - 138,000; Part time

Job summary

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. You will assess vignette accuracy, reasoning quality, and the presence of distractors across multiple organ systems, scoring and providing short rationales for each item.

Projects are based on active phases and require clinical judgment, with compensation per accepted task. Rates are up to $100 per hour, depending on tier and efficiency, and work is primarily remote within the United

Qualifications

• Medical degree (MD or DO) with an active, unrestricted US license.
• Board certification or completed residency with recent direct patient care.
• Broad diagnostic and treatment experience across multiple organ systems.
• Strong clinical reasoning and guideline application.
• Experience in medical AI evaluation or QA is a plus.
• Excellent written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across organ systems.
• Score vignette reasoning quality, accuracy, and trap quality.
• Check whether reasoning traces lead to the correct answer from vignette facts.
• Write concise rationales and participate in physician adjudication.

Skills

MD/DO

Active US license

Board cert or residency

Multi-system medicine

Clinical reasoning

AI evaluation experience

Strong written English

Job description

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. You will assess vignette accuracy, reasoning quality, and the presence of distractors across multiple organ systems, scoring and providing short rationales for each item.

Projects are based on active phases and require clinical judgment, with compensation per accepted task. Rates are up to $100 per hour, depending on tier and efficiency, and work is primarily remote within the United