Part-Time Medical AI Evaluator (MD/DO)

Mindrift; Clayton (MO); Remote; USD 69,000 - 96,000; Part time

Job summary

Mindrift is seeking US-based physicians to evaluate EHR vignettes for an AI evaluation program. You will review diagnostic and treatment items, score reasoning quality, and provide brief rationales.

This project-based, part-time opportunity focuses on internal and family medicine and requires active medical licensure and strong English communication. Contributors work in a peer-blind, multi-read process with physician adjudication.

Qualifications

• Must have an MD or DO with active US medical license.
• Board certification or completed residency with recent patient care.
• Broad diagnostic and treatment experience across multiple medical systems.
• Strong clinical reasoning and evidence-based practice.
• Experience in medical AI evaluation or annotation is a plus.
• Strong written English skills (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score reasoning quality, vignette accuracy, and trap quality.
• Check whether reasoning chains reach conclusions from vignette data.
• Draft concise rationales and contribute to adjudication processes.

Skills

Medical degree and US medical license

Board certification or residency

Multi-system clinical experience

Clinical reasoning

Medical AI evaluation experience

English writing (C1+)

Education

MD or DO degree

Job description

Mindrift is seeking US-based physicians to evaluate EHR vignettes for an AI evaluation program. You will review diagnostic and treatment items, score reasoning quality, and provide brief rationales.

This project-based, part-time opportunity focuses on internal and family medicine and requires active medical licensure and strong English communication. Contributors work in a peer-blind, multi-read process with physician adjudication.