Remote Medical AI QA Evaluator (MD/DO) - Flexible

Toloka; Arkansas; Remote; USD 28,000 - 41,000; Part time

Benefits offered by this job

Onboarding reward

Flexible remote project

Job summary

Mindrift is seeking licensed US physicians to evaluate clinical EHR vignettes for an AI evaluation project. Work is remote and independent, with no patient contact. You will review cases, score reasoning quality, and provide concise rationales.

Earnings are task-based, with a $50 onboarding reward after your first approved task and additional QA incentives. Contributors review written cases, spanning multiple systems, and are compensated per task with flexible scheduling and no minimum hours.

Qualifications

• Active US medical license required and verified at onboarding.
• Board certification or residency training with direct patient care experience.
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning: differential diagnosis, next-step management, and evidence-based guidelines.
• Prior experience in medical AI evaluation or medical annotation is a plus; strong written English is required.

Responsibilities

• Evaluate written clinical EHR vignettes and questions across various medical domains.
• Score clinical reasoning quality, vignette accuracy, completeness, and evaluate trap quality.
• Write brief rationales explaining reasoning and conclusions.

Skills

Active US medical license

Clinical reasoning

Strong written English

Education

MD/DO degree

Board certification or residency completed

Job description

Mindrift is seeking licensed US physicians to evaluate clinical EHR vignettes for an AI evaluation project. Work is remote and independent, with no patient contact. You will review cases, score reasoning quality, and provide concise rationales.

Earnings are task-based, with a $50 onboarding reward after your first approved task and additional QA incentives. Contributors review written cases, spanning multiple systems, and are compensated per task with flexible scheduling and no minimum hours.