Part-Time Physician AI Evaluation Specialist

Mindrift; Manchester; Remote; GBP 44,000 - 73,000; Part time

Benefits offered by this job

Pay per task

Remote project-based work

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This opportunity involves evaluating clinical EHR vignettes for a medical AI evaluation program; participation is project-based.

Open to US-based physicians with MD/DO, board certification or completed residency, and an active medical license. Tasks include scoring reasoning quality, adjudication across blind reads, and providing short

Qualifications

• Medical degree (MD or DO) and active, unrestricted US medical license.
• Board certification or completed residency with recent direct patient care.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score clinical reasoning quality across vignette-related tasks.
• Check whether reasoning traces lead to the correct answer from vignette facts.
• Provide short rationales and participate in three blind reads with physician adjudication.

Skills

Medical knowledge

Clinical reasoning

Written English

Education

MD/DO degree

Board certification / Residency

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This opportunity involves evaluating clinical EHR vignettes for a medical AI evaluation program; participation is project-based.

Open to US-based physicians with MD/DO, board certification or completed residency, and an active medical license. Tasks include scoring reasoning quality, adjudication across blind reads, and providing short