Physician MD/DO—Part-Time Medical AI Evaluation

Mindrift; Birmingham; Remote; GBP 3,200 - 5,300; Full time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. This opportunity is project-based and remote.

We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes, score reasoning quality, and write brief rationales. Tasks are ~10–20 hours per week during active phases, paid per accepted task at up to $70/hr.

Qualifications

• MD or DO with active US license.
• Board certification or recent residency.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and use of evidence-based guidelines.
• Experience in medical AI evaluation or annotation is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” across multiple medical domains.
• Score the clinical reasoning quality of benchmark items (diagnosis, treatment, accuracy, and trap quality).
• Check whether reasoning reaches conclusions from vignette facts alone and provide short rationales.
• Undergo physician adjudication and contribute to improving AI tools.

Skills

MD/DO

US medical license

Board cert / residency

Multi-system experience

Clinical reasoning

AI evaluation experience

Written English

Education

MD or DO

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. This opportunity is project-based and remote.

We are seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes, score reasoning quality, and write brief rationales. Tasks are ~10–20 hours per week during active phases, paid per accepted task at up to $70/hr.