Part-Time Clinical AI Evaluator (MD/DO)

Mindrift; Minneota (MN); On-site; USD 80,000 - 113,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We seek US-based physicians to evaluate clinical EHR vignettes for an AI evaluation program, mainly in general and internal medicine.

Contributors may evaluate vignettes, score reasoning quality, check whether the reasoning can be traced from vignette facts, and write concise rationales. This is a part-time, project-based role with paid tasks.

Qualifications

• Medical degree (MD or DO) and an active US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad diagnostic and treatment experience across multiple medical areas.
• Strong clinical reasoning and application of guidelines.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors across systems.
• Score diagnostic reasoning quality, vignette accuracy, and trap quality.
• Assess whether reasoning reaches the answer from vignette facts and write short rationales.
• Participate in three independent blind reads with physician adjudication.

Skills

Clinical reasoning

Medical AI evaluation experience

Medical annotation/QA

Strong written English

Education

MD or DO degree

Active US medical license

Board certification or residency training

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We seek US-based physicians to evaluate clinical EHR vignettes for an AI evaluation program, mainly in general and internal medicine.

Contributors may evaluate vignettes, score reasoning quality, check whether the reasoning can be traced from vignette facts, and write concise rationales. This is a part-time, project-based role with paid tasks.