Remote Physician AI QA Evaluator (MD/DO)

Toloka; New Mexico; Remote; USD 11,000 - 56,000; Part time

Benefits offered by this job

Onboarding reward ($50)

Quality incentives

Job summary

Mindrift is seeking US-licensed physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation project. You will review written cases, score reasoning quality, and provide concise rationales.

Tasks are remote, independent, and depend on accepting project criteria across multiple medical domains. The ideal candidate holds an active license, board certification or residency, strong clinical reasoning, and excellent written English.

Qualifications

• Active US medical license (verified at onboarding and re-check monthly).
• Board certification or completed residency training with direct patient care experience.
• Strong clinical reasoning and differential diagnosis skills.
• Experience in medical AI evaluation, clinical content, or exam-question review is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes and score reasoning quality.
• Review cases across multiple systems (cardiovascular, nervous, hematologic, etc.).
• Provide short rationales and ensure alignment with acceptance criteria.
• Participate in independent reads and physician adjudication rounds.

Skills

US medical license

Board certification or residency

Clinical reasoning

Medical AI evaluation experience

Written English proficiency

Education

MD or DO

Job description

Mindrift is seeking US-licensed physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation project. You will review written cases, score reasoning quality, and provide concise rationales.

Tasks are remote, independent, and depend on accepting project criteria across multiple medical domains. The ideal candidate holds an active license, board certification or residency, strong clinical reasoning, and excellent written English.