Part-Time AI Medical Reviewer (MD/DO)

Mindrift; Fort Collins (CO); On-site; USD 114,000 - 162,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We are looking for US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

Participation is project-based with compensation paid per accepted task, up to the equivalent of $100/hr. Tasks require 10–20 hours per week during active phases.

Qualifications

• MD or DO degree is required with an active, unrestricted US medical license.
• Board certification or completed residency training (internal/general/hospital medicine) is preferred.
• Broad, multi-system diagnostic and treatment experience is expected.
• Strong clinical reasoning and application of evidence-based guidelines is essential.
• Experience in medical AI evaluation/annotation is a plus; high-quality written English is required.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and trap answers across multiple organ systems.
• Score the clinical reasoning quality, vignette accuracy, completeness, and trap quality; assess reasoning traces.
• Write short rationales and ensure reasoning traces reach the answer from vignette facts.
• Work within three independent blind reads, followed by physician adjudication and final determination.

Skills

Clinical reasoning

Medical knowledge

English writing

Attention to detail

Ethics & privacy

Education

MD or DO degree

Active US medical license

Board certification or residency completed

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We are looking for US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

Participation is project-based with compensation paid per accepted task, up to the equivalent of $100/hr. Tasks require 10–20 hours per week during active phases.