Part-Time Physician AI Evaluation Specialist

Mindrift; City of Edinburgh; Remote; GBP 60,000 - 86,000; Part time

Job summary

Mindrift invites US-based physicians to participate in a project-based AI evaluation program. You will evaluate clinical EHR vignettes, score clinical reasoning, and craft short rationales. This role is part-time, project-based, and remote, with compensation tied to task acceptance and tiered qualification.

Contributors may engage 10–20 hours weekly during active phases. Prior AI evaluation experience is a plus; strong English communication is essential.

Qualifications

• This opportunity requires an MD or DO and an active, unrestricted US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad diagnostic/treatment experience across internal, family, emergency or hospital medicine.
• Strong clinical reasoning and application of evidence-based guidelines.
• Prior experience in medical AI evaluation or annotation is a plus.
• Excellent written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractors.
• Score vignette reasoning quality and answer accuracy.
• Check whether reasoning reaches the correct conclusion from vignette facts.
• Write concise rationales and participate in physician adjudication across reads.

Skills

MD/DO

Active US medical license

Board certification or residency

Multisystem clinical experience

Clinical reasoning

Medical AI evaluation experience

Strong written English

Education

MD/DO degree

Job description

Mindrift invites US-based physicians to participate in a project-based AI evaluation program. You will evaluate clinical EHR vignettes, score clinical reasoning, and craft short rationales. This role is part-time, project-based, and remote, with compensation tied to task acceptance and tiered qualification.

Contributors may engage 10–20 hours weekly during active phases. Prior AI evaluation experience is a plus; strong English communication is essential.