Medical AI Reviewer (MD/DO) – Part-Time, US-Based

Mindrift; Lorida (FL); Remote; USD 107,000 - 179,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based.

We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, with emphasis on general and internal medicine. Tasks are ~10–20 hours/week, paid per accepted task, up to $130/hr.

Qualifications

• MD/DO degree or equivalent.
• Active, unrestricted US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad diagnostic experience across multiple systems.
• Strong clinical reasoning and decision-making.
• Experience in medical AI evaluation or QA is a plus.
• Fluent written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, answers, and distractors.
• Score the clinical reasoning quality of items (accuracy, completeness, trap quality).
• Assess whether reasoning traces lead from vignette facts to answers; write short rationales.

Skills

Strong written English

Education

MD/DO

Active US medical license

Board certification

Residency training

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based.

We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, with emphasis on general and internal medicine. Tasks are ~10–20 hours/week, paid per accepted task, up to $130/hr.