MD/DO Part-Time Medical AI Evaluation Specialist

Mindrift; Oklahoma; Remote; USD 114,000 - 162,000; Part time

Job summary

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. Responsibilities include scoring reasoning quality, annotating rationale, and adjudicating across three blind reads. Part-time, project-based work with flexible hours up to ~20 hours per week.

Ideal candidates hold an MD/DO with a current unrestricted US license, board certification or residency, and strong written English. Compensation up to $100/hr, commensurate with qualification tier.

Qualifications

• Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
• Board certification or completed residency training, with recent direct patient care (attending-level preferred);
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
• Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
• Strong written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes across diagnosis and treatment tasks.
• Score clinical reasoning quality and gradeability of items.
• Write concise rationales and ensure reasoning traces are clear.
• Participate in three blind reads with physician adjudication.

Skills

Clinical reasoning

Medical AI evaluation experience

Medical annotation/QA

Strong written English

Education

MD or DO

Active US medical license

Board certification or residency training

Job description

Mindrift seeks US-based physicians (MD/DO) to evaluate clinical EHR vignettes for AI evaluation projects. Responsibilities include scoring reasoning quality, annotating rationale, and adjudicating across three blind reads. Part-time, project-based work with flexible hours up to ~20 hours per week.

Ideal candidates hold an MD/DO with a current unrestricted US license, board certification or residency, and strong written English. Compensation up to $100/hr, commensurate with qualification tier.