Remote Physician Reviewer for Medical AI Evaluation

Mindrift; Grand Rapids (MI); Remote; USD 124,000 - 152,000; Part time

Benefits offered by this job

Onboarding reward

Job summary

Mindrift is seeking actively practicing physicians (MD/DO) with a US license to evaluate clinical EHR vignettes for a medical AI evaluation project. You review vignettes, score reasoning quality, and write concise rationales, with three independent blind reads and physician adjudication.

Contributors may work remotely, choose hours 10–20 per week during active phases, and receive a flat rate per approved task along with a $50 onboarding reward after first production task is approved.

Qualifications

• Active, unrestricted US medical license (onboarding verification and monthly re-check)
• Board certification or completed residency with recent direct patient care
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• High level of clinical reasoning and application of guidelines
• Experience in medical AI evaluation, clinical content, or QA is a plus
• Excellent written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes with questions, answers, and distractors across multiple medical domains
• Score reasoning quality, vignette accuracy, and trap quality
• Check whether reasoning traces lead to the answer from vignette facts
• Write short rationales; participate in independent blind reads and physician adjudication

Skills

Strong written English

Education

MD or DO

Job description

Mindrift is seeking actively practicing physicians (MD/DO) with a US license to evaluate clinical EHR vignettes for a medical AI evaluation project. You review vignettes, score reasoning quality, and write concise rationales, with three independent blind reads and physician adjudication.

Contributors may work remotely, choose hours 10–20 per week during active phases, and receive a flat rate per approved task along with a $50 onboarding reward after first production task is approved.