Remote MD/DO Medical AI Evaluator — Flexible Hours

Mindrift; Minneapolis (MN); Remote; USD 124,000 - 152,000; Full time

Job summary

Mindrift is seeking actively practicing MDs or DOs with a US license to evaluate clinical EHR vignettes for AI evaluation projects. You will review cases across multiple systems, score reasoning quality, and provide concise rationales, all while working remotely and around your clinical practice.

This role offers around 10–20 hours per week during active phases, with a flat per-task rate near $100/hour equivalent and a $50 onboarding reward after first approved task.

Qualifications

• MD or DO with active, unrestricted US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning and application of evidence-based guidelines.
• Experience in medical AI evaluation or medical annotation is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score vignette accuracy, completeness, and trap quality.
• Assess reasoning traces and write short rationales.
• Participate in three blind reads with physician adjudication.
• Contribute around 10–20 hours per week while the project is active.

Skills

Strong written English

Education

MD/DO with US license

Board certification or residency

US clinical practice experience

Job description

Mindrift is seeking actively practicing MDs or DOs with a US license to evaluate clinical EHR vignettes for AI evaluation projects. You will review cases across multiple systems, score reasoning quality, and provide concise rationales, all while working remotely and around your clinical practice.

This role offers around 10–20 hours per week during active phases, with a flat per-task rate near $100/hour equivalent and a $50 onboarding reward after first approved task.