Part-Time Medical AI Evaluation Specialist (MD/DO)

Mindrift; Yorktown (VA); Hybrid; USD 41,000 - 179,000; Part time

Job summary

Mindrift invites US-based physicians (MD/DO) to participate in a part-time, project-based AI evaluation program. You will assess clinical EHR vignettes, score reasoning quality, and provide concise rationales under blinded review procedures.

Compensation is paid per accepted task, with rates up to $130 per hour depending on the qualification tier and task complexity, offering flexible engagement while contributing to advancing medical AI systems.

Qualifications

• MD or DO with active US medical license.
• Board certification or completed residency training.
• Broad multi-system diagnostic and treatment experience across internal, family, emergency, or hospital medicine.
• Strong clinical reasoning and application of evidence-based guidelines.
• Prior experience in medical AI evaluation, clinical content review, or medical annotation/QA is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors.
• Score reasoning quality: vignette accuracy, completeness, and trap quality.
• Check whether reasoning traces lead to the answer from vignette facts and write short rationales.
• Participate in three independent blind reads followed by physician adjudication.

Skills

Clinical reasoning

Medical knowledge

English proficiency

Education

MD/DO

US medical license

Board certification or residency

Job description

Mindrift invites US-based physicians (MD/DO) to participate in a part-time, project-based AI evaluation program. You will assess clinical EHR vignettes, score reasoning quality, and provide concise rationales under blinded review procedures.

Compensation is paid per accepted task, with rates up to $130 per hour depending on the qualification tier and task complexity, offering flexible engagement while contributing to advancing medical AI systems.