Physician AI Evaluation Specialist for Medical Vignettes

Mindrift; Minnesota; Remote; USD 83,000 - 179,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based.

We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI medical evaluation program. Tasks require 10–20 hours/week, with compensation paid per accepted task up to $130/hr. Strong written English is required.

Qualifications

• Medical degree (MD or DO) and an active, unrestricted US medical license.
• Board certification or completed residency training, with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning: differential diagnosis, next-step management, and evidence-based guidelines.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across multiple systems.
• Score reasoning quality: vignette accuracy, completeness, and trap quality.
• Check whether reasoning traces lead to the answer using vignette facts alone, and write short rationales.
• Work within three independent blind reads, followed by physician adjudication.

Skills

Clinical reasoning

Medical knowledge

English proficiency

Education

MD or DO

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based.

We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI medical evaluation program. Tasks require 10–20 hours/week, with compensation paid per accepted task up to $130/hr. Strong written English is required.