Clinical AI Evaluator - MD/DO Physician (Part-Time)

Mindrift; Canada; Remote; CAD 159,000 - 227,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We are seeking practicing physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation programs.

Contributors may work on multiple tasks, with compensation paid per accepted task up to $100 per hour. Roles are part-time, non-permanent, and require high-level clinical expertise and strong written English.

Qualifications

• MD or DO with active US license.
• Board certification or completed residency with recent direct patient care.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and guideline knowledge.
• Experience in medical AI evaluation or medical annotation is a plus.
• Excellent written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors across multiple medical domains.
• Score clinical reasoning quality, vignette accuracy, and trap quality.
• Check whether reasoning reaches the answer from vignette facts and provide concise rationales.
• Participate in three independent blind reads with physician adjudication.

Skills

Medical degree

US medical license

Board certification

Residency training

Clinical reasoning

AI evaluation experience

Medical annotation

Written English

Education

MD or DO

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We are seeking practicing physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation programs.

Contributors may work on multiple tasks, with compensation paid per accepted task up to $100 per hour. Roles are part-time, non-permanent, and require high-level clinical expertise and strong written English.