Part-Time Physician AI Evaluation Specialist (MD/DO)

Mindrift; Iowa; Remote; USD 83,000 - 138,000; Part time

Benefits offered by this job

Project-based work

Flexible schedule

Job summary

Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for AI evaluation projects. You will assess diagnosis and treatment items, score reasoning quality, and provide concise rationales, working through three blind reads with physician adjudication.

This role emphasizes rigorous clinical reasoning and high-quality written English. Projects are part-time and project-based, with compensation up to $100/hour.

Qualifications

• MD or DO degree and active US medical license required.
• Board certification or recent residency with direct patient care preferred.
• Broad, multi-system diagnostic and treatment experience across internal, family, emergency, or hospital medicine.
• Strong clinical reasoning and application of guidelines for differential diagnosis.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors.
• Score clinical reasoning quality: vignette accuracy, completeness, and trap quality.
• Check whether reasoning reaches the answer from vignette facts and write concise rationales.
• Participate in three blind reads followed by physician adjudication.

Skills

Clinical reasoning

Medical AI evaluation experience

Written English (C1+)

Multi-system diagnostic skills

Education

MD or DO

US medical license (active, unrestricted)

Board certification or residency completed

Job description

Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for AI evaluation projects. You will assess diagnosis and treatment items, score reasoning quality, and provide concise rationales, working through three blind reads with physician adjudication.

This role emphasizes rigorous clinical reasoning and high-quality written English. Projects are part-time and project-based, with compensation up to $100/hour.