Physician AI Evaluation Reviewer (MD/DO) – Part-Time

Mindrift; Clayton (MO); Remote; USD 58,000 - 96,000; Part time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. You will score reasoning quality, assess vignette accuracy, and write concise rationales.

This is a part-time, project-based engagement with multiple blind reads and physician adjudication, focusing on internal and family medicine scenarios. Active US medical license and board certification or residency training are required; strong written English is essential.

Qualifications

• MD/DO degree and active US license required.
• Board certification or residency with recent direct patient care.
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis, next-step management, and guideline application.
• Prior experience in medical AI evaluation or medical annotation/QA is a plus.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractor options.
• Score reasoning quality: vignette accuracy, completeness, and trap quality.
• Verify reasoning chains from vignette facts and write concise rationales.
• Participate in physician adjudication to ensure accurate evaluation.

Skills

MD/DO

Active US medical license

Board certification

Residency training

Clinical reasoning

Medical AI evaluation

Medical annotation/QA

Strong English (C1+)

Education

MD/DO degree

US medical license

Board certification or residency

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. You will score reasoning quality, assess vignette accuracy, and write concise rationales.

This is a part-time, project-based engagement with multiple blind reads and physician adjudication, focusing on internal and family medicine scenarios. Active US medical license and board certification or residency training are required; strong written English is essential.