Medical AI Evaluation Specialist (MD/DO) - Project-Based

Mindrift; Colorado Springs (CO); Remote; USD 83,000 - 138,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program.

You will review vignettes, score reasoning quality, write concise rationales, and participate in multiple blind reads with physician adjudication. This is a flex-time, project-based engagement with compensation per accepted task.

Qualifications

• Medical degree (MD or DO) and active US license.
• Board certification or completed residency with recent direct patient care.
• Broad multi-system diagnostic experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning and application of evidence-based guidelines.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score the clinical reasoning quality of benchmark items and trap quality.
• Check whether reasoning traces reach the answer from vignette facts alone; write short rationales.
• Participate in three independent blind reads followed by physician adjudication.

Skills

Clinical reasoning

Strong written English

Education

MD/DO, medical license

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program.

You will review vignettes, score reasoning quality, write concise rationales, and participate in multiple blind reads with physician adjudication. This is a flex-time, project-based engagement with compensation per accepted task.