Part-Time Medical AI Evaluator (MD/DO)

Mindrift; Minnesota; A distancia; USD 58.000 - 96.000; A tiempo parcial

Descripción de la vacante

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, focusing on general and internal medicine.

Contributors will evaluate vignette pairs, score reasoning quality, and provide concise rationales. Projects are part-time, non-permanent, with compensation per accepted task.

Formación

• MD or DO with active US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning and evidence-based guideline application.
• Experience in medical AI evaluation/annotation is a plus.
• Strong written English (C1+).

Responsabilidades

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractor options across multiple body systems.
• Score clinical reasoning quality of benchmark items, including vignette accuracy, completeness, and trap quality.
• Verify that reasoning chains reach the answer from vignette facts and write concise rationales.
• Work within three independent blind reads followed by physician adjudication.

Conocimientos

Active US medical license

Strong clinical reasoning

Multi-system diagnostic experience

Experience in medical AI evaluation/QA

Excellent written English

Educación

MD or DO

Board certification or residency completed

Descripción del empleo

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, focusing on general and internal medicine.

Contributors will evaluate vignette pairs, score reasoning quality, and provide concise rationales. Projects are part-time, non-permanent, with compensation per accepted task.