Part-Time Physician: AI Clinical Evaluation & QA Expert

Mindrift; Iowa; Remote; USD 55,000 - 179,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for testing and improving AI systems. We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for our medical AI evaluation program, focusing on general and internal medicine.

Contributors will review vignettes, score reasoning, ensure chain-of-thought logic, and write concise rationales. Projects are part-time, remote, with pay per accepted task, up to $130 per hour.

Qualifications

• MD/DO with active, unrestricted US medical license.
• Board certified or completed residency with recent direct patient care.
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, hospital medicine).
• Strong clinical reasoning: differential diagnosis and management.
• Prior experience in medical AI evaluation or medical annotation/QA is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors across multiple systems.
• Score clinical reasoning quality of benchmark items and assess vignette accuracy and gradeability.
• Verify whether reasoning reaches the answer from vignette data and document clear rationales.
• Participate in three independent blind reads followed by physician adjudication.

Skills

US MD/DO license

Board certification or residency

Multi-system clinical experience

Clinical reasoning

AI evaluation experience

Strong written English

Education

Medical degree (MD/DO)

Job description

Mindrift connects specialists with project-based AI opportunities for testing and improving AI systems. We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for our medical AI evaluation program, focusing on general and internal medicine.

Contributors will review vignettes, score reasoning, ensure chain-of-thought logic, and write concise rationales. Projects are part-time, remote, with pay per accepted task, up to $130 per hour.