Physician MD/DO - Medical AI Evaluation (Part-Time)

Mindrift; New York (NY); Remote; USD 69,000 - 179,000; Part time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. You will review vignette-based questions, rate reasoning quality, and write concise rationales.

Projects are part-time and engagement is per-accepted-task, with a pay rate up to $130/hr. Ideal candidates hold an active US medical license, board certification or recent residency, and demonstrated multi-system clinical experience.

Qualifications

• Active, unrestricted US medical license (verified with the medical board).
• Board certification or completed residency training with recent direct patient care (attending level preferred).
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis, next-step management, evidence-based guidelines.

Responsibilities

• Evaluate clinical EHR vignettes paired with a question, proposed answer, and distractor across multiple systems.
• Score the clinical reasoning quality of benchmark items, vignette accuracy, and trap quality.
• Check whether reasoning traces reach the answer from vignette facts and write short rationales.
• Participate in three blind reads followed by physician adjudication.

Skills

Clinical reasoning

Strong written English

Attention to detail

Education

MD or DO

Board certification or completed residency

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. You will review vignette-based questions, rate reasoning quality, and write concise rationales.

Projects are part-time and engagement is per-accepted-task, with a pay rate up to $130/hr. Ideal candidates hold an active US medical license, board certification or recent residency, and demonstrated multi-system clinical experience.