Physician for Medical AI Evaluation & QA (Part-Time)

Mindrift; Arizona; Remote; USD 83,000 - 179,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We’re seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program, with tasks spanning multiple systems and requiring strong clinical reasoning.

This opportunity is part-time and project-based. Contributors will evaluate vignettes, score reasoning quality, write concise rationales, and participate in blinded

Qualifications

• MD or DO with active US license required.
• Board certification or completed residency training preferred.
• Strong written English (C1+) required.
• Experience in medical AI evaluation or clinical content is a plus.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, answers, and distractors across multiple medical domains.
• Score clinical reasoning quality, vignette accuracy, and trap quality.
• Write short rationales and ensure reasoning traces are complete.
• Participate in multiple blind reads with physician adjudication.

Skills

Clinical reasoning

Medical English

AI evaluation experience

Education

MD/DO

Active US medical license

Board certification or residency training

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We’re seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program, with tasks spanning multiple systems and requiring strong clinical reasoning.

This opportunity is part-time and project-based. Contributors will evaluate vignettes, score reasoning quality, write concise rationales, and participate in blinded