Part-Time Physician (MD/DO) for AI Evaluation

Mindrift; Iowa Center (IA); On-site; USD 55,000 - 96,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re seeking US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

This opportunity is part-time and non-permanent. Projects involve evaluating multi-system cases, scoring reasoning quality, and writing concise rationales.

Qualifications

• US-based, actively practicing physicians (MD or DO) with active US medical license
• Board certification or completed residency training, with recent direct patient care
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• Strong written English and ability to provide concise rationales for reasoning traces

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across multiple medical domains.
• Score clinical reasoning quality, vignette accuracy, completeness, and trap quality.
• Assess whether reasoning chains reach answers from vignette facts and write short rationales.
• Participate in three blind reads with physician adjudication to refine AI evaluation tools.

Skills

Clinical reasoning

Strong written English

Multi-system medical experience

Education

MD/DO (Medical degree)

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re seeking US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

This opportunity is part-time and non-permanent. Projects involve evaluating multi-system cases, scoring reasoning quality, and writing concise rationales.