Part-Time Medical AI Evaluator (MD/DO)

Mindrift; Erie (Erie County); A distancia; USD 114.000 - 162.000; A tiempo parcial

Descripción de la vacante

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We are seeking US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

Contributors will assess vignette quality, score reasoning, and write concise rationales, with three independent blind reads and physician adjudication.

Formación

• MD or DO and an active, unrestricted US medical license
• Board certification or completed residency training with recent direct patient care
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• Strong clinical reasoning and application of evidence-based guidelines
• Prior experience in medical AI evaluation, clinical content, or medical annotation/QA a plus
• Strong written English (C1+)

Responsabilidades

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor options across multiple organ systems
• Score the clinical reasoning quality of benchmark items including vignette accuracy, completeness, and trap quality
• Check whether reasoning traces lead from vignette facts to the correct answer and write short rationales
• Participate in three independent blind reads followed by physician adjudication

Conocimientos

Clinical reasoning

Written English

Medical AI evaluation

US medical license

Educación

MD or DO

Descripción del empleo

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We are seeking US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

Contributors will assess vignette quality, score reasoning, and write concise rationales, with three independent blind reads and physician adjudication.