Part-Time Physician for Medical AI Evaluation & QA

Mindrift; Wisconsin; On-site; USD 83,000 - 179,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re seeking US-based physicians to evaluate clinical EHR vignettes and score reasoning quality across multiple medical domains.

Projects run ~10–20 hours per week, paid per accepted task, with rates up to $130/hr. Ideal candidates hold an MD/DO with an active US license and board certification or recent residency, plus strong clinical

Qualifications

• MD or DO with active, unrestricted US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and application of guidelines.
• Experience in medical AI evaluation or annotation is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score reasoning quality: vignette accuracy, completeness, trap quality.
• Check how reasoning reaches the answer from vignette facts and write rationales.
• Work within three independent blind reads with physician adjudication.
• Contribute to improving AI tools you may use.

Skills

Strong written English

Clinical reasoning

Education

MD/DO

US Medical License

Board Certification / Residency

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re seeking US-based physicians to evaluate clinical EHR vignettes and score reasoning quality across multiple medical domains.

Projects run ~10–20 hours per week, paid per accepted task, with rates up to $130/hr. Ideal candidates hold an MD/DO with an active US license and board certification or recent residency, plus strong clinical