Part-Time Medical AI Evaluator (MD/DO)

Braintrust; Frankfort (KY); Remote; USD 138,000 - 276,000; Part time

Job summary

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. Focus areas include general and internal medicine, with project-based, non-permanent participation.

You will score reasoning quality, assess vignette accuracy, and provide concise rationales. Expect 10–20 hours weekly during active phases, with eligibility limited to states listed.

Qualifications

• Must have a medical degree (MD or DO) with an active US license.
• Broad diagnostic and treatment experience across multiple systems is preferred.
• Strong written English is required (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across various medical domains.
• Score clinical reasoning quality: vignette accuracy, completeness, trap quality, and overall correctness.
• Write concise rationales and ensure reasoning traces align with vignette facts.
• Collaborate with three independent blind readers and physician adjudication as needed.

Skills

Clinical reasoning

Medical knowledge

US licensed physician

English proficiency

Education

MD or DO

Job description

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. Focus areas include general and internal medicine, with project-based, non-permanent participation.

You will score reasoning quality, assess vignette accuracy, and provide concise rationales. Expect 10–20 hours weekly during active phases, with eligibility limited to states listed.