MD/DO Clinical AI Evaluator — Vignette QA

Mindrift; Missouri; Remote; USD 58,000 - 96,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program.

Contributors may work 10–20 hours per week on part-time, non-permanent projects, with compensation paid per accepted task up to $70/hr, depending on task tier and efficiency. Strong clinical reasoning and English skills are essential.

Qualifications

• MD or DO with active US license.
• Board certification or completed residency with recent direct patient care.
• Broad multi-system diagnostic and treatment experience across internal, family, emergency, or hospital medicine.
• Strong clinical reasoning and ability to apply evidence-based guidelines.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions and distractors.
• Score the clinical reasoning quality, vignette accuracy, completeness, and trap quality.
• Check whether reasoning reaches the answer from vignette facts and write short rationales.
• Participate in three independent blind reads followed by physician adjudication.

Skills

Clinical reasoning

Written English

Medical evaluation

Education

MD or DO degree

Active US medical license

Board certification or residency completed

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program.

Contributors may work 10–20 hours per week on part-time, non-permanent projects, with compensation paid per accepted task up to $70/hr, depending on task tier and efficiency. Strong clinical reasoning and English skills are essential.