Clinical AI Evaluation Reviewer (MD/DO) - Part-Time

Mindrift; Iowa Center (IA); Remote; USD 107,000 - 179,000; Part time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. The role is project-based and parts of a three-reader process with physician adjudication to ensure high-quality AI tools.

Expect 10–20 hours per week during active phases, paid per accepted task. Compensation depends on tier and efficiency, up to a rate of $130/hr.

Qualifications

• MD or DO degree and an active, unrestricted US medical license.
• Board certification or completed residency training with recent direct patient care.
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis, next-step management, guideline application.
• Prior experience in medical AI evaluation or annotation is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors.
• Score the clinical reasoning quality of benchmark items and assess vignette accuracy.
• Check whether reasoning traces lead from vignette facts to the correct answer; write short rationales.
• Participate in three independent blind reads followed by physician adjudication.

Skills

Strong written English (C1+)

Multisystem medical knowledge

Education

MD or DO degree

Active US medical license

Board certification or completed residency training

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. The role is project-based and parts of a three-reader process with physician adjudication to ensure high-quality AI tools.

Expect 10–20 hours per week during active phases, paid per accepted task. Compensation depends on tier and efficiency, up to a rate of $130/hr.