Part-Time Physician: AI Medical Vignette Evaluator

Mindrift; Yuma (AZ); On-site; USD 80,000 - 113,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. US-based physicians (MD/DO) are invited to evaluate clinical EHR vignettes.

Contributors will score clinical reasoning, check reasoning traces, and write concise rationales. Projects are non-permanent and part-time; compensation is task-based.

Qualifications

• MD or DO with an active, unrestricted US medical license
• Board certification or completed residency training with recent direct patient care
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• Strong clinical reasoning: differential diagnosis, next-step management, and application of guidelines
• Prior experience in medical AI evaluation, content review, or medical annotation/QA is a plus
• Strong written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across multiple medical domains
• Score the clinical reasoning quality of benchmark items (diagnostic accuracy, completeness, and trap quality)
• Check whether reasoning chains are based on vignette facts and write short rationales
• Participate in three blind reads followed by physician adjudication to improve AI tools

Skills

Strong written English

Clinical reasoning

Multisystem diagnostic experience

Active US medical license

Board certification or residency

Education

MD/DO degree

Residency training or board certification

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. US-based physicians (MD/DO) are invited to evaluate clinical EHR vignettes.

Contributors will score clinical reasoning, check reasoning traces, and write concise rationales. Projects are non-permanent and part-time; compensation is task-based.