Part-Time Physician for Medical AI Evaluation (EHR Vignettes)

Mindrift; Denver (CO); Remote; USD 55,000 - 96,000; Part time

Job summary

Mindrift invites US-based physicians to join a project-based AI evaluation program that tests and improves medical AI by evaluating clinical EHR vignettes, focusing on internal and general medicine.

Contributors will score reasoning quality, check chain-of-thought traces, and write concise rationales across multi-system cases. The role is part-time, non-permanent, and paid per accepted task up to $70 per hour.

Qualifications

• MD or DO degree and active, unrestricted US medical license.
• Board certification or completed residency training with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across multiple body systems.
• Score clinical reasoning quality including vignette accuracy, completeness, and trap quality.
• Check whether reasoning chains reach the answer from vignette facts and write short rationales.
• Participate in three blind reads followed by physician adjudication.

Skills

Strong written English

Education

MD or DO

Active, unrestricted US medical license

Board certification or completed residency training

Job description

Mindrift invites US-based physicians to join a project-based AI evaluation program that tests and improves medical AI by evaluating clinical EHR vignettes, focusing on internal and general medicine.

Contributors will score reasoning quality, check chain-of-thought traces, and write concise rationales across multi-system cases. The role is part-time, non-permanent, and paid per accepted task up to $70 per hour.