Medical AI Evaluation Specialist (MD/DO) – Part-Time

Mindrift; Kentucky; Remote; USD 83,000 - 138,000; Part time

Benefits offered by this job

Paid per accepted task

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. Participation is project-based, with tasks involving diagnosis and treatment across multiple organ systems. You will assess reasoning quality, traceable steps, and write concise rationales.

Projects are part-time and paid per accepted task, supporting a flexible schedule. The role emphasizes high English proficiency (C1+) and official medical licensure.

Qualifications

• Active US medical license required.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and application of guidelines.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers and distractors across medical domains.
• Score clinical reasoning quality, vignette accuracy, and trap quality.
• Write brief rationales and ensure reasoning traces align with vignette facts.

Skills

Active US medical license

Clinical reasoning

Multi-system diagnostic experience

Medical AI evaluation experience

Strong written English

Education

MD or DO

Board certification or residency

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. Participation is project-based, with tasks involving diagnosis and treatment across multiple organ systems. You will assess reasoning quality, traceable steps, and write concise rationales.

Projects are part-time and paid per accepted task, supporting a flexible schedule. The role emphasizes high English proficiency (C1+) and official medical licensure.