Physician AI Evaluation Reviewer (MD/DO)

Mindrift; United States; Remote; USD 41,000 - 96,000; Part time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program focused on testing, evaluating, and improving AI systems. You will work on diagnosis and treatment tasks across multiple medical domains, scoring reasoning quality and writing brief rationales.

This opportunity is designed for part-time, non-permanent projects with pay per accepted task. Candidates should hold an MD/DO and an active US medical license, with board certification or

Qualifications

• MD or DO with active US medical license.
• Board certification or residency training with recent direct patient care.
• Broad multi-system diagnostic and treatment experience and strong clinical reasoning.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score clinical reasoning quality including vignette accuracy, completeness, and trap quality.
• Check reasoning chains for sufficiency and write short rationales.
• Participate in three independent blind reads followed by physician adjudication.

Skills

Medical license

Board certification

Clinical reasoning

Strong written English

Education

MD/DO degree

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program focused on testing, evaluating, and improving AI systems. You will work on diagnosis and treatment tasks across multiple medical domains, scoring reasoning quality and writing brief rationales.

This opportunity is designed for part-time, non-permanent projects with pay per accepted task. Candidates should hold an MD/DO and an active US medical license, with board certification or