US-Based AI Medical Evaluator (MD/DO) — Part-Time

Mindrift; Green Bay (WI); Remote; USD 110,000 - 138,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

Contributors will assess multi-system cases, score reasoning quality, and write concise rationales. This role is part-time, with compensation up to $100/hr and roughly 10–20 hours per week during active phases.

Qualifications

• MD or DO with an active, unrestricted US medical license.
• Board certification or completed residency training.
• Broad multi-system diagnostic and treatment experience (internal, family, hospital medicine).
• Strong clinical reasoning: differential diagnosis, next steps, guideline application.
• Experience in medical AI evaluation, content review, or annotation is a plus.
• Excellent written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor options across multiple body systems.
• Score the clinical reasoning quality and vignette accuracy and gradeability.
• Verify that reasoning follows vignette facts and document concise rationales.
• Participate in three blind reads with physician adjudication to reach a final decision.

Skills

Strong clinical reasoning

Active US medical license

Broad multi-system experience

Strong written English

Education

Medical degree (MD or DO)

Active US medical license (unrestricted)

Board certification or residency training

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

Contributors will assess multi-system cases, score reasoning quality, and write concise rationales. This role is part-time, with compensation up to $100/hr and roughly 10–20 hours per week during active phases.