Part-Time Medical AI Evaluator (MD/DO)

Mindrift; Yuma (AZ); On-site; USD 80,000 - 113,000; Part time

Job summary

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. Tasks include scoring reasoning quality, verifying vignette accuracy, and writing concise rationales across multiple medical domains.

Projects are part-time and non-permanent, with compensation tied to task acceptance and an hourly rate up to $70. Ideal candidates have board certification or recent residency, strong clinical reasoning, and excellent written English.

Qualifications

• MD or DO degree required with active license
• Board certification or residency completed; direct patient care preferred
• Strong clinical reasoning and ability to apply evidence-based guidelines
• Prior experience in medical AI evaluation or medical annotation is a plus
• Excellent written English (C1+) required

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors
• Score reasoning quality, vignette accuracy, and trap quality
• Assess whether reasoning traces reach conclusions from vignette facts
• Prepare short rationales and provide adjudication input

Skills

Clinical reasoning

Medical English

AI evaluation experience

Attention to detail

Education

MD/DO degree

Board certification or residency

Job description

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. Tasks include scoring reasoning quality, verifying vignette accuracy, and writing concise rationales across multiple medical domains.

Projects are part-time and non-permanent, with compensation tied to task acceptance and an hourly rate up to $70. Ideal candidates have board certification or recent residency, strong clinical reasoning, and excellent written English.