Medical AI Evaluation Specialist (MD/DO) - Part-Time

Mindrift; Central City (KY); A distancia; USD 107.000 - 179.000; A tiempo parcial

Descripción de la vacante

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This US-based opportunity seeks practicing physicians to evaluate clinical EHR vignettes.

You will work part-time on tasks such as scoring clinical reasoning, rating vignette accuracy, and writing concise rationales, with compensation per accepted task up to $130 per hour.

Formación

• Active, unrestricted US medical license (verified with the issuing board).
• Board certification or completed residency with recent direct patient care (attending-level preferred).
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines.
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus).
• Strong written English (C1+).

Responsabilidades

• Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across multiple medical systems.
• Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, trap quality, and answer correctness.
• Check whether the reasoning chain reaches the answer from vignette facts alone and write short rationales.
• Work within three independent blind reads, followed by physician adjudication.

Conocimientos

Medical license

MD/DO degree

Board certification or residency

Clinical reasoning

Medical AI evaluation

English proficiency

Educación

MD/DO degree

Descripción del empleo

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This US-based opportunity seeks practicing physicians to evaluate clinical EHR vignettes.

You will work part-time on tasks such as scoring clinical reasoning, rating vignette accuracy, and writing concise rationales, with compensation per accepted task up to $130 per hour.