Clinical AI Evaluation for Physicians (MD/DO) – Part-Time

Mindrift; United States; Remote; USD 83,000 - 110,000; Part time

Benefits offered by this job

Up to $80/hr

Part-time, project-based

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. The work is project-based, part-time, and focused on testing, evaluating, and improving AI systems. Contributors review vignettes across multiple medical domains, score reasoning quality, and provide brief rationales.

Compensation is paid per accepted task, with rates up to $80 per hour. This opportunity requires an active medical license and strong written English skills.

Qualifications

• US-based physicians with an active, unrestricted medical license.
• Strong English writing skills (C1+).
• Experience in medical AI evaluation or medical annotation/QA is a plus.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across multiple medical domains.
• Score reasoning quality, accuracy, completeness, and trap quality.
• Check whether reasoning traces lead to the answer from vignette facts and write short rationales.

Skills

Strong written English

Clinical reasoning

Medical AI evaluation

Medical annotation/QA

Education

MD or DO

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. The work is project-based, part-time, and focused on testing, evaluating, and improving AI systems. Contributors review vignettes across multiple medical domains, score reasoning quality, and provide brief rationales.

Compensation is paid per accepted task, with rates up to $80 per hour. This opportunity requires an active medical license and strong written English skills.