Physician (MD/DO) — AI Evaluation & QA — Part-Time

Mindrift; Lorida (FL); On-site; USD 58,000 - 96,000; Part time

Job summary

Mindrift connects physicians with project-based AI evaluation tasks to assess clinical vignettes drawn from real patient cases. You will evaluate EHR vignettes, score reasoning quality, and write concise rationales. This is a part-time, US-based engagement designed for physicians actively practicing medicine.

The program involves blind reads and adjudication, focusing on accuracy, evidence-based guidelines, and clear documentation. Strong English writing is essential.

Qualifications

• MD or DO with active US medical license.
• Board certification or residency with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning and knowledge of guidelines.
• Experience in medical AI evaluation or QA is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with a question, a proposed answer, and a distractor “trap” answer across multiple medical systems.
• Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality.
• Check whether the reasoning chain reaches the answer from vignette facts alone, and write short rationales.
• Work within three independent blind reads, followed by physician adjudication.

Skills

Clinical reasoning

Strong written English

Multi-system experience

Education

MD or DO with active US medical license

Board certification or residency with recent direct patient care

Job description

Mindrift connects physicians with project-based AI evaluation tasks to assess clinical vignettes drawn from real patient cases. You will evaluate EHR vignettes, score reasoning quality, and write concise rationales. This is a part-time, US-based engagement designed for physicians actively practicing medicine.

The program involves blind reads and adjudication, focusing on accuracy, evidence-based guidelines, and clear documentation. Strong English writing is essential.