Part-Time Medical AI Evaluator (MD/DO)

Mindrift; Fulton (MS); Remote; USD 83,000 - 179,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for our medical AI evaluation program, focusing on general and internal medicine.

Contributors may work 10–20 hours per week during active phases, paid per accepted task, with rates up to $130/hr.

Qualifications

• US-based practicing physicians (MD/DO) with active license.
• Board certification or completed residency training.
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning and evidence-based approach.
• Experience in medical AI evaluation a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors.
• Score clinical reasoning quality, vignette accuracy, and trap quality.
• Check whether reasoning traces reach the answer from vignette facts.
• Prepare short rationales for adjudication and participate in physician adjudication.

Skills

MD/DO background

US medical license

Board certification / residency

Clinical reasoning

Multi-system experience

English proficiency

Education

MD or DO degree

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for our medical AI evaluation program, focusing on general and internal medicine.

Contributors may work 10–20 hours per week during active phases, paid per accepted task, with rates up to $130/hr.