Physician Evaluator for Medical AI QA (Part-Time)

Mindrift; Michigan; Remote; USD 110,000 - 179,000; Part time

Benefits offered by this job

Part-time projects

Pay up to $130/hr

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies. US-based physicians will evaluate clinical EHR vignettes, score reasoning quality, and write concise rationales to improve AI tools.

This part-time, non-permanent project requires an active medical license, board credentials, and strong English writing. Tasks are paid per accepted item, with rates up to $130 per hour depending on tier and efficiency.

Qualifications

• MD or DO degree and active, unrestricted US medical license (verified with issuing medical board).
• Board certification or completed residency training with recent direct patient care (attending-level preferred).
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines.
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score the clinical reasoning quality and item gradeability.
• Check reasoning chains and write short rationales.
• Participate in three blind reads with physician adjudication.

Skills

MD/DO

Active License

Board Certified

Residency Completed

Clinical Reasoning

Medical AI Experience

English Proficiency

Education

MD or DO degree

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies. US-based physicians will evaluate clinical EHR vignettes, score reasoning quality, and write concise rationales to improve AI tools.

This part-time, non-permanent project requires an active medical license, board credentials, and strong English writing. Tasks are paid per accepted item, with rates up to $130 per hour depending on tier and efficiency.