Part-Time AI Medical Evaluator (MD/DO) – Clinical Vignettes

Mindrift; Yuma (AZ); Remote; USD 80,000 - 113,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re looking for US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, with emphasis on general and internal medicine.

Projects are part-time and paid per accepted task. Expect about 10–20 hours per week during active phases.

Qualifications

• MD or DO and an active US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractor options across multiple medical domains.
• Score the clinical reasoning quality of benchmark items, including vignette accuracy, answer correctness, and trap quality.
• Check whether the reasoning chain reaches the answer from vignette facts alone and write short rationales.
• Participate in three independent blind reads followed by physician adjudication.

Skills

MD or DO

Active US medical license

Board-certified or completed residency

Clinical reasoning

Education

MD/DO degree

US medical license

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re looking for US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, with emphasis on general and internal medicine.

Projects are part-time and paid per accepted task. Expect about 10–20 hours per week during active phases.