Clinical AI Quality Evaluator (MD/DO) – Part-Time

Mindrift; Duluth (MN); Remote; USD 83,000 - 138,000; Part time

Benefits offered by this job

Remote work

Flexible hours

Project-based compensation

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for our AI evaluation program. You will assess diagnostic and treatment tasks across multiple systems, score reasoning quality, and draft short rationales.

This is project-based and part-time, with compensation up to $100/hr. Ideal candidates hold an active US medical license, board certification or completed residency, and strong written English.

Qualifications

• MD or DO with active US license.
• Board certification or completed residency with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning and application of guidelines.
• Experience in medical AI evaluation or medical annotation is a plus.
• Excellent written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers and distractors.
• Score reasoning quality across vignette accuracy, completeness, and trap quality.
• Assess whether reasoning reaches the answer from vignette facts; write concise rationales.
• Work with independent reads and physician adjudication. Maintain quality standards.

Skills

Strong English

Clinical reasoning

Medical AI evaluation

Education

MD or DO

Board certification or residency

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for our AI evaluation program. You will assess diagnostic and treatment tasks across multiple systems, score reasoning quality, and draft short rationales.

This is project-based and part-time, with compensation up to $100/hr. Ideal candidates hold an active US medical license, board certification or completed residency, and strong written English.