Physician AI Quality Evaluator for Medical Vignettes

Mindrift; Colorado; On-site; USD 83,000 - 179,000; Part time

Job summary

Mindrift connects physicians with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. This role seeks US-based physicians to evaluate clinical EHR vignettes for an AI evaluation program, primarily in general and internal medicine.

You will score reasoning quality, verify vignette accuracy, and craft concise rationales, working within three blind reads and physician adjudication. This is a part-time, project-based engagement.

Qualifications

• MD or DO with an active US medical license.
• Board-certified or recent residency with direct patient care.
• Broad multi-system diagnostic and treatment experience.
• Strong written English skills (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score clinical reasoning quality: vignette accuracy, completeness, and trap quality.
• Check whether reasoning chains reach conclusions from vignette facts.
• Draft short rationales and participate in blind reads with adjudication.

Skills

Clinical reasoning

Strong written English

Education

MD or DO

Board certification or residency training

Job description

Mindrift connects physicians with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. This role seeks US-based physicians to evaluate clinical EHR vignettes for an AI evaluation program, primarily in general and internal medicine.

You will score reasoning quality, verify vignette accuracy, and craft concise rationales, working within three blind reads and physician adjudication. This is a part-time, project-based engagement.