Remote MD/DO: Medical AI Evaluation Reviewer

Toloka; Nevada; Remote; USD 2,000 - 6,000; Part time

Benefits offered by this job

Onboarding reward $50

Job summary

Mindrift seeks licensed physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for an AI evaluation project. You will assess multi-system cases, score reasoning quality, and contribute brief rationales for each task.

The role is remote, with flexible, task-based participation and onboarding reward. Board certification or residency experience is valued, and English writing must be strong to ensure clear documentation.

Qualifications

• MD or DO with active, unrestricted US medical license.
• Board certification or completed residency with direct patient care experience.
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong clinical reasoning and application of evidence-based guidelines.

Responsibilities

• Evaluate clinical EHR vignettes for AI evaluation tasks.
• Score vignette quality: accuracy, completeness, and reasoning chain.
• Write concise rationales and provide per-case feedback.
• Undergo three blind reads and physician adjudication for each case.

Skills

Strong written English

Clinical reasoning

US medical license

Broad multi-system experience

Education

MD or DO

Job description

Mindrift seeks licensed physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for an AI evaluation project. You will assess multi-system cases, score reasoning quality, and contribute brief rationales for each task.

The role is remote, with flexible, task-based participation and onboarding reward. Board certification or residency experience is valued, and English writing must be strong to ensure clear documentation.