Remote Physician Reviewer (MD/DO) - Flexible AI Evaluation

Mindrift; Georgia; Remote; USD 124,000 - 165,000; Part time

Benefits offered by this job

Onboarding reward

Job summary

Mindrift is seeking actively practicing US physicians with an active license to evaluate clinical EHR vignettes for a medical AI evaluation project. You review cases across various systems, scoring reasoning quality and ensuring answers are supported by vignette data.

The role is flexible, project-based, with tasks estimated around 10–20 hours weekly while active. Onboarding includes a $50 reward after your first approved task, plus incentives for high-quality work.

Qualifications

• MD/DO with active US medical license
• Board certification or completed residency
• Broad, multi-system diagnostic and treatment experience
• Strong clinical reasoning and application of guidelines
• Experience in medical AI evaluation or QA is a plus
• High proficiency in written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers and distractors across multiple medical systems.
• Score clinical reasoning quality and vignette accuracy, including trap quality and completeness.
• Assess whether reasoning traces lead from vignette facts to the answer; write concise rationales.
• Participate in three independent blind reads followed by physician adjudication.

Skills

MD/DO

US medical license

Board cert or residency

Clinical reasoning

Medical AI evaluation

Strong written English

Education

Medical degree (MD/DO)

Job description

Mindrift is seeking actively practicing US physicians with an active license to evaluate clinical EHR vignettes for a medical AI evaluation project. You review cases across various systems, scoring reasoning quality and ensuring answers are supported by vignette data.

The role is flexible, project-based, with tasks estimated around 10–20 hours weekly while active. Onboarding includes a $50 reward after your first approved task, plus incentives for high-quality work.