Part-Time Physician AI Evaluation Reviewer (MD/DO)

Mindrift; Saint Paul (MN); On-site; USD 83,000 - 138,000; Part time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Part-time, project-based work with compensation per accepted task up to $100/hr.

Contributors will score reasoning quality across multiple medical systems, provide concise rationales, and participate in blinded reads with adjudication. Strong English proficiency is required.

Qualifications

• MD/DO degree required and valid US medical license.
• Experience with medical AI evaluation, content review, or QA is a plus.
• Excellent written English and ability to evaluate clinical vignettes.

Responsibilities

• Evaluate clinical EHR vignettes for AI evaluation tasks.
• Score reasoning quality, vignette accuracy, and trap quality.
• Draft short rationales and ensure reasoning traces are clear.
• Work in three independent blind reads with physician adjudication.

Skills

Strong clinical reasoning

Active US medical license

Board certification or residency

Medical annotation/QA experience in AI

Excellent written English (C1+)

Education

MD or DO degree

Active US medical license (citation)

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Part-time, project-based work with compensation per accepted task up to $100/hr.

Contributors will score reasoning quality across multiple medical systems, provide concise rationales, and participate in blinded reads with adjudication. Strong English proficiency is required.