Part-Time AI Medical Evaluation Physician (MD/DO)

Mindrift; Tampa (FL); Remote; USD 114,000 - 162,000; Part time

Job summary

Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for an AI evaluation program. You will score reasoning quality, assess vignette accuracy, and provide short rationales.

This is a part-time, project-based role with flexible hours for contributors who are actively practicing physicians. Requirements include an MD/DO with an active US license, board certification or recent residency, broad diagnostic experience, and excellent written English.

Qualifications

• MD or DO with active US medical license.
• Board certification or residency training with recent direct patient care.
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis, next-step management, and evidence-based guidelines.
• Prior experience in medical AI evaluation or medical annotation is a plus.
• Strong written English (C1).

Responsibilities

• Evaluate clinical EHR vignettes and pair with questions, proposed answers, and distractors across multiple medical domains.
• Score reasoning quality, vignette accuracy, and trap quality.
• Check whether reasoning chains reach conclusions from vignette facts; write short rationales.
• Contribute to improving AI tools through physician adjudication and feedback.

Skills

Strong clinical reasoning

Strong written English

Education

MD/DO with US medical license

Board certification or residency completed

Job description

Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for an AI evaluation program. You will score reasoning quality, assess vignette accuracy, and provide short rationales.

This is a part-time, project-based role with flexible hours for contributors who are actively practicing physicians. Requirements include an MD/DO with an active US license, board certification or recent residency, broad diagnostic experience, and excellent written English.