Remote Physician: Medical AI Evaluation QA

Mindrift; Cleveland (OH); Remote; USD 124,000 - 152,000; Full time

Job summary

Mindrift seeks actively practicing physicians (MD/DO) with a US license to evaluate clinical EHR vignettes for a medical AI evaluation project. You review cases across multiple systems and score reasoning quality, ensuring that conclusions are supported by vignette facts.

The role emphasizes strong clinical reasoning, evidence-based guidelines, and high-quality written English. This project offers flexible, remote collaboration around your clinical practice.

Qualifications

• Medical degree (MD or DO) with active US license.
• Board certification or residency with recent direct patient care.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and knowledge of guidelines.
• Experience in medical AI evaluation or medical annotation is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes for AI evaluation tasks.
• Score clinical reasoning quality, vignette accuracy and gradeability.
• Assess whether reasoning traces reach the answer from vignette facts.
• Write short rationales for decisions.
• Participate in three blinded reads with physician adjudication.

Skills

Clinical reasoning

English proficiency (C1+)

Review of clinical vignettes

Medical knowledge

Education

MD or DO

Board certification or residency training

Job description

Mindrift seeks actively practicing physicians (MD/DO) with a US license to evaluate clinical EHR vignettes for a medical AI evaluation project. You review cases across multiple systems and score reasoning quality, ensuring that conclusions are supported by vignette facts.

The role emphasizes strong clinical reasoning, evidence-based guidelines, and high-quality written English. This project offers flexible, remote collaboration around your clinical practice.