AI Medical EHR Evaluator – Licensed Physician (Part-Time)

Mindrift; Oklahoma City (OK); Remote; USD 58,000 - 96,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program.

Tasks are paid per accepted item, up to $70/hr, on a part-time, non-permanent basis. Ideal candidates have an active US medical license, board certification or recent residency, broad multi-system experience, and strong clinical reasoning.

Qualifications

• MD or DO with active US license.
• Board certification or recent residency training.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and evidence-based practice.
• Experience in medical AI evaluation or QA is a plus.
• Excellent written English.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score reasoning quality, vignette accuracy, and trap quality.
• Assess whether reasoning traces lead from vignette facts to answers and write short rationales.
• Work within three blind reads and physician adjudication.

Skills

MD/DO

Board certification

Residency training

Clinical reasoning

Medical AI evaluation

English proficiency

Education

MD/DO degree

Active US medical license

Board certification or residency

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program.

Tasks are paid per accepted item, up to $70/hr, on a part-time, non-permanent basis. Ideal candidates have an active US medical license, board certification or recent residency, broad multi-system experience, and strong clinical reasoning.