Remote MD/DO Medical AI Evaluator – Flexible Tasks

Mindrift (Toloka); United States; Remote; USD 45,000 - 85,000; Part time

Benefits offered by this job

Onboarding reward $50

Remote work

Job summary

Mindrift (Toloka) is seeking US-licensed physicians to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review written cases, score reasoning quality, and write concise rationales.

This is a task-based, independent contractor role with fully self-scheduled participation and onboarding rewards. Ideal candidates hold an MD/DO with active license, broad multi-system experience, and strong English writing.

Qualifications

• Active, unrestricted US medical license
• Board certification or residency training with direct patient care experience
• Broad diagnostic and treatment experience across internal, family, emergency or hospital medicine
• Strong clinical reasoning and application of guidelines
• Prior experience in medical AI evaluation or content review is a plus
• Excellent written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes and questions across multiple medical domains
• Score vignette quality, completeness, and reasoning traces
• Provide concise rationales for conclusions and document assessments

Skills

US medical license

Board certification or residency

Multi-system clinical experience

Clinical reasoning

Medical AI evaluation/QA experience

Strong written English

Education

MD or DO

Job description

Mindrift (Toloka) is seeking US-licensed physicians to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review written cases, score reasoning quality, and write concise rationales.

This is a task-based, independent contractor role with fully self-scheduled participation and onboarding rewards. Ideal candidates hold an MD/DO with active license, broad multi-system experience, and strong English writing.