Part-Time Medical AI Evaluation Physician (MD/DO)

Braintrust; Madison (WI); Remote; USD 83,000 - 138,000; Part time

Job summary

Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program focused on general and internal medicine. Participation is project-based and non-permanent, with about 10–20 hours weekly during active phases.

Requirements include MD/DO with active US license, board certification or residency, broad multi-system diagnostic experience, and strong written English. Open to physicians in eligible US states including Wisconsin.

Qualifications

• MD or DO with active US medical license and board cert or residency training.
• Strong written English (C1+) and ability to articulate clinical reasoning clearly.
• Experience evaluating medical AI content, exam questions, or QA is a plus.
• Broad multi-system diagnostic and treatment experience across internal, family, emergency, or hospital medicine.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across multiple medical systems.
• Score clinical reasoning quality, vignette accuracy, completeness, and trap quality.
• Assess whether reasoning chains derive the answer from vignette facts alone and write concise rationales.
• Work within three independent blind reads, followed by physician adjudication for complex cases.

Skills

Strong written English

Clinical reasoning

Medical AI evaluation experience

Education

Medical degree (MD or DO)

Active, unrestricted US medical license

Board certification or completed residency training

Job description

Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program focused on general and internal medicine. Participation is project-based and non-permanent, with about 10–20 hours weekly during active phases.

Requirements include MD/DO with active US license, board certification or residency, broad multi-system diagnostic experience, and strong written English. Open to physicians in eligible US states including Wisconsin.