Part-Time Medical AI Evaluator (MD/DO)

Mindrift; United States; Remote; USD 114,000 - 162,000; Part time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Focus areas include multiple medical systems and assessment of diagnostic and treatment reasoning.

Tasks involve scoring and writing concise rationales to ensure quality of clinical reasoning. Ideal candidates hold an active US medical license, board certification or recent residency, and have broad clinical experience across internal, family, emergency, or hospital medicine.

Qualifications

• MD/DO with active US license and board certification or residency completed.
• Broad diagnostic experience across multiple medical systems.
• Experience with clinical AI evaluation or medical annotation is a plus.

Responsibilities

• Evaluate clinical EHR vignettes with questions, answers, and distractors.
• Score reasoning quality, vignette accuracy, and trap quality.
• Write short rationales and ensure correct reasoning traces.
• Participate in three blind reads with physician adjudication.

Skills

Clinical reasoning

Evidence-based guidelines

Multi-system diagnostic experience

Education

MD/DO degree

Active US medical license

Board certification or completed residency

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Focus areas include multiple medical systems and assessment of diagnostic and treatment reasoning.

Tasks involve scoring and writing concise rationales to ensure quality of clinical reasoning. Ideal candidates hold an active US medical license, board certification or recent residency, and have broad clinical experience across internal, family, emergency, or hospital medicine.