Part-Time Physician AI Evaluator — EHR Vignettes QA

Mindrift; United States; Remote; USD 55,000 - 96,000; Part time

Job summary

Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program. You will review vignettes with questions, score reasoning quality, and provide concise rationales.

This is a part-time, project-based opportunity focused on testing and improving AI systems. Ideal candidates hold an MD or DO with an active US license, board certification or recent residency, and strong English writing skills.

Qualifications

• MD or DO with active, unrestricted US license.
• Board certification or completed residency with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning and guideline application.
• Experience in medical AI evaluation or QA is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with a question, proposed answer, and distractor across multiple systems.
• Score clinical reasoning quality: vignette accuracy, completeness, trap quality, and whether the reasoning reaches the answer from vignette facts.
• Check reasoning traces and write short rationales.
• Work in three independent blind reads with physician adjudication.

Skills

Clinical reasoning

English proficiency

Medical documentation

Education

MD or DO

Active US medical license

Job description

Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program. You will review vignettes with questions, score reasoning quality, and provide concise rationales.

This is a part-time, project-based opportunity focused on testing and improving AI systems. Ideal candidates hold an MD or DO with an active US license, board certification or recent residency, and strong English writing skills.