Part-Time Physician Reviewer for AI Evaluation (MD/DO)

Mindrift; Michigan; Remote; USD 55,000 - 96,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for testing, evaluating, and improving AI systems. We are seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program, focusing on general and internal medicine.

Contributors participate in around 10–20 hours per week during active phases, with compensation paid per accepted task up to $70/hour. This is a part-time, non-permanent project-based opportunity designed for practicing physicians.

Qualifications

• MD or DO degree required and active US medical license verified with issuing board.
• Board certification or completed residency with recent direct patient care (attending-level preferred).
• Broad, multi-system diagnostic and treatment experience across internal, family, emergency, or hospital medicine.
• Strong clinical reasoning, differential diagnosis, next-step management, and evidence-based guidelines.
• Prior experience in medical AI evaluation, content review, or medical annotation/QA is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions and proposed answers across multiple body systems.
• Score clinical reasoning quality of benchmark items (accuracy, completeness, trap quality).
• Check reasoning chains reach conclusions from vignette facts and write concise rationales.
• Participate in three independent blind reads followed by physician adjudication; engage in real clinical complexity.

Skills

Clinical reasoning

Written English proficiency

Multi-system diagnostic experience

Ability to evaluate AI medical content

Attention to detail

Education

MD/DO degree

Active US medical license

Board certification or completed residency

Job description

Mindrift connects specialists with project-based AI opportunities for testing, evaluating, and improving AI systems. We are seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program, focusing on general and internal medicine.

Contributors participate in around 10–20 hours per week during active phases, with compensation paid per accepted task up to $70/hour. This is a part-time, non-permanent project-based opportunity designed for practicing physicians.