Remote MD/DO Medical Reviewer for AI Evaluation & QA

Toloka; Kansas; Remote; USD 34,000 - 83,000; Full time

Benefits offered by this job

Onboarding reward $50

Remote work for US physicians

Flexible, self-scheduled tasks

Job summary

Mindrift is seeking US-licensed physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation project. You will review vignettes, rate diagnostic reasoning, and write brief rationales.

Contributors work remotely with fully self-scheduled tasks, three independent reads per case, and adjudication. Earnings are task-based with onboarding rewards and quality incentives; practice flow fits around clinical commitments.

Qualifications

• Active, unrestricted US medical license (onboarding and monthly re-check).
• Board certification or completed residency with direct patient care experience.
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis, next-step management, evidence-based guidelines.
• Prior experience in medical AI evaluation, clinical content review, or medical QA is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, a proposed answer, and a distractor "trap" across multiple systems.
• Score clinical reasoning quality: vignette accuracy, completeness, answer correctness, and trap quality.
• Check whether the reasoning chain reaches the answer from vignette facts, and write short rationales.

Skills

Active US medical license

MD/DO degree

Board certification or residency

Clinical reasoning

Written English (C1+)

Education

MD or DO

Job description

Mindrift is seeking US-licensed physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation project. You will review vignettes, rate diagnostic reasoning, and write brief rationales.

Contributors work remotely with fully self-scheduled tasks, three independent reads per case, and adjudication. Earnings are task-based with onboarding rewards and quality incentives; practice flow fits around clinical commitments.