Physician AI QA Specialist (MD/DO) - Part-Time

Mindrift; Yorktown (VA); On-site; USD 80,000 - 113,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program, with internal and family medicine as primary focus.

Tasks are paid per accepted item, with compensation up to $70/hr depending on qualification tier and task efficiency.

Qualifications

• MD or DO with active, unrestricted US medical license.
• Board certification or completed residency training with recent direct patient care.
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning and application of evidence-based guidelines.
• Prior experience in medical AI evaluation or medical annotation/QA is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers, and distractor options.
• Score reasoning quality, vignette accuracy, and trap quality.
• Assess whether reasoning traces lead to answers using vignette facts.
• Provide short rationales and contribute to physician adjudication.

Skills

Strong written English

Clinical reasoning

Education

MD or DO (medical degree)

Active US medical license

Board certification or residency training

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program, with internal and family medicine as primary focus.

Tasks are paid per accepted item, with compensation up to $70/hr depending on qualification tier and task efficiency.