Part-Time Internal Medicine AI Evaluation Physician

Mindrift; Houston (TX); Remote; USD 80,000 - 113,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, primarily in general and internal medicine. Tasks typically require about 10–20 hours per week during active phases, and compensation is paid per accepted task, up to $70/hr.

Qualifications

• MD or DO with an active US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad multi-system diagnostic experience (internal, family, ED, or hospital medicine).
• Strong clinical reasoning and knowledge of evidence-based guidelines.
• Experience in medical AI evaluation or exam-question review is a plus.

Responsibilities

• Evaluate clinical EHR vignettes with a question, a proposed answer, and a distractor.
• Score the clinical reasoning quality of benchmark items across systems.
• Check whether reasoning traces reach the answer from vignette facts and write rationales.
• Work within three blind reads, followed by physician adjudication.

Skills

Clinical reasoning

Medical AI evaluation

English proficiency

Education

MD/DO degree

Active US medical license

Board certification or residency

Tools

Annotation tools

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, primarily in general and internal medicine. Tasks typically require about 10–20 hours per week during active phases, and compensation is paid per accepted task, up to $70/hr.