Part-Time Medical AI Evaluator (MD/DO)

Mindrift; Oklahoma City (OK); Remote; USD 58,000 - 96,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. This is a US-based, part-time, project-based engagement for practicing physicians (MD/DO) to evaluate clinical EHR vignettes.

Contributors will assess vignette questions, rate reasoning quality, and write concise rationales across multiple medical domains. The role is paid per accepted task, with rates up to $70 per hour depending on

Qualifications

• US-based physician with MD or DO and active US medical license.
• Board certification or recent residency with direct patient care.
• Broad multi-system diagnostic and treatment experience.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score reasoning quality, vignette accuracy, and trap quality.
• Assess whether reasoning reaches conclusions from vignette facts and document rationales.
• Adjudication across three independent reads.

Skills

Strong clinical reasoning

Strong written English (C1+)

Experience in medical AI evaluation

Education

MD or DO degree

Board certification or residency completed

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. This is a US-based, part-time, project-based engagement for practicing physicians (MD/DO) to evaluate clinical EHR vignettes.

Contributors will assess vignette questions, rate reasoning quality, and write concise rationales across multiple medical domains. The role is paid per accepted task, with rates up to $70 per hour depending on