Remote Medical AI Evaluation Reviewer

Mindrift; Columbus (OH); Remote; USD 114,000 - 162,000; Full time

Benefits offered by this job

Onboarding bonus

Flexible schedule

Job summary

Mindrift is seeking actively practicing MDs or DOs with an active US medical license to review clinical EHR vignettes for an AI evaluation project. You will evaluate vignette questions, proposed answers, and distractors, scoring reasoning quality and legality of the reasoning path.

Contributors work remotely, with flexible hours around clinical practice. Onboarding provides a $50 reward after first production task, and base rate is equivalent to about $100/hour for approved tasks.

Qualifications

• MD or DO with active US medical license and board certification or completed residency.
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis, next-step management, and evidence-based guidelines.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score clinical reasoning quality, vignette accuracy, completeness, and trap quality.
• Check whether reasoning chains reach the answer from vignette facts and write short rationales.
• Participate in independent blind reads and physician adjudication.

Skills

Strong written English (C1+)

Education

MD or DO degree

Job description

Mindrift is seeking actively practicing MDs or DOs with an active US medical license to review clinical EHR vignettes for an AI evaluation project. You will evaluate vignette questions, proposed answers, and distractors, scoring reasoning quality and legality of the reasoning path.

Contributors work remotely, with flexible hours around clinical practice. Onboarding provides a $50 reward after first production task, and base rate is equivalent to about $100/hour for approved tasks.