Physician AI Evaluation Specialist: Medical Vignette QA

Mindrift; Macon (GA); On-site; USD 83,000 - 138,000; Part time

Job summary

Mindrift is recruiting US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, focusing on general and internal medicine across multiple organ systems. This is a project-based opportunity with compensation per task.

You will review vignettes, score reasoning quality, and write concise rationales. Eligible physicians hold an active US license, board certification or residency, and strong English writing skills. Tasks are paid per accepted item.

Qualifications

• MD/DO with active, unrestricted US medical license.
• Board certification or completed residency training with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience across internal, family, emergency, or hospital medicine.
• Strong clinical reasoning and application of evidence-based guidelines.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across multiple systems.
• Score the clinical reasoning quality of benchmark items and assess vignette accuracy and trap quality.
• Write short rationales and check whether reasoning reaches the answer from vignette facts alone.
• Participate in three blind reads followed by physician adjudication.

Skills

Clinical reasoning

Written English

Education

MD/DO

Board certification or residency

Job description

Mindrift is recruiting US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, focusing on general and internal medicine across multiple organ systems. This is a project-based opportunity with compensation per task.

You will review vignettes, score reasoning quality, and write concise rationales. Eligible physicians hold an active US license, board certification or residency, and strong English writing skills. Tasks are paid per accepted item.