Part-Time AI Medical Evaluator (MD/DO)

Mindrift; Kenosha (WI); Remote; USD 83,000 - 138,000; Part time

Job summary

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects focused on testing, evaluating, and improving AI systems. The role is project-based and part-time, with compensation per accepted task up to $100/hr.

Tasks involve multi-system clinical scenarios across cardiology, neurology, hematology, and more, with strict quality and reasoning requirements. Contributors will work in a remote, project-based setting, typically 10–20 hours weekly during

Qualifications

• MD or DO with active US medical license
• Board certification or completed residency with recent direct patient care
• Broad, multi-system diagnostic and treatment experience
• Strong clinical reasoning and application of guidelines
• Experience in medical AI evaluation or medical annotation is a plus
• Proficient written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes paired with questions and proposed answers
• Score the clinical reasoning quality, vignette accuracy, and completeness
• Check reasoning traces and write concise rationales
• Participate in three blind reads with physician adjudication
• Contribute to improving AI evaluation tools

Skills

Clinical reasoning

Strong written English

Medical license (US)

US-based physician

Multisystem experience

Education

MD or DO

Job description

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects focused on testing, evaluating, and improving AI systems. The role is project-based and part-time, with compensation per accepted task up to $100/hr.

Tasks involve multi-system clinical scenarios across cardiology, neurology, hematology, and more, with strict quality and reasoning requirements. Contributors will work in a remote, project-based setting, typically 10–20 hours weekly during