US MD/DO Physician AI Evaluation Specialist

Mindrift; Orlando (FL); Remote; USD 83,000 - 138,000; Part time

Job summary

Mindrift invites US-based physicians to participate in a project-based medical AI evaluation program. You will evaluate clinical EHR vignettes, score reasoning quality, and write concise rationales across multiple systems.

Tasks run 10–20 hours per week during active phases; compensation is task-based, up to $100 per hour, with adjudication by physicians. This is a flexible, part-time opportunity for clinicians seeking non-permanent work.

Qualifications

• MD or DO with active US medical license
• Board certification or completed residency with recent direct patient care
• Broad multi-system diagnostic and treatment experience across internal, family, emergency, or hospital medicine
• Strong clinical reasoning: differential diagnosis, next-step management, and application of guidelines
• Prior experience in medical AI evaluation, medical annotation/QA is a plus
• Strong written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes paired with questions and distractors across multiple body systems
• Score the clinical reasoning quality of benchmark items and assess vignette accuracy and completeness
• Check whether reasoning traces reach the answer from vignette facts and write short rationales
• Participate in three blind reads with physician adjudication and contribute to final judgments

Skills

MD/DO

US license

Board cert

Residency

Clinical reasoning

AI evaluation

Written English

Education

MD/DO degree

Job description

Mindrift invites US-based physicians to participate in a project-based medical AI evaluation program. You will evaluate clinical EHR vignettes, score reasoning quality, and write concise rationales across multiple systems.

Tasks run 10–20 hours per week during active phases; compensation is task-based, up to $100 per hour, with adjudication by physicians. This is a flexible, part-time opportunity for clinicians seeking non-permanent work.