Remote MD/DO: AI Evaluation Reviewer

Mindrift; Gresham (OR); Remote; USD 114,000 - 162,000; Full time

Benefits offered by this job

Onboarding reward

Incentives for high-quality tasks

Flexible hours

Job summary

Mindrift is seeking actively practicing physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You review cases, score reasoning quality, and write concise rationales, within three blind reads and physician adjudication.

Contributions are project-based and allow flexible timing from anywhere. You must hold an MD or DO, have an active unrestricted US license, and possess strong English writing skills.

Qualifications

• MD/DO with active US medical license (verified at onboarding)
• Board certification or completed residency training, with recent direct patient care
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• Strong clinical reasoning: differential diagnosis, next-step management, and evidence-based guidelines
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is a plus
• Strong written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes for medical AI evaluation projects across multiple medical domains
• Score the clinical reasoning quality of benchmark items including vignette accuracy and completeness
• Check whether reasoning chains reach the correct answer from vignette facts and write short rationales
• Work within three blind reads followed by physician adjudication to ensure high-quality evaluations

Skills

Strong written English (C1+)

Education

MD or DO

Job description

Mindrift is seeking actively practicing physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You review cases, score reasoning quality, and write concise rationales, within three blind reads and physician adjudication.

Contributions are project-based and allow flexible timing from anywhere. You must hold an MD or DO, have an active unrestricted US license, and possess strong English writing skills.