Remote Medical AI Evaluator (MD/DO) - Flexible, Task-Based

Toloka; Tennessee; Remote; USD 6,900 - 28,000; Full time

Benefits offered by this job

Onboarding reward

Quality incentives

Job summary

Mindrift seeks physicians (MD/DO) with active US medical licenses to evaluate clinical EHR vignettes for an AI evaluation project. You will work on written cases across multiple systems, score reasoning quality, and write concise rationales.

This is a remote, task-based, independent contractor opportunity with onboarding rewards and potential quality incentives. Ideal candidates have board certification or residency, broad multi-system experience, strong clinical reasoning, and excellent written

Qualifications

• Must hold an MD or DO with an active US medical license.
• Board certification or completed residency training with direct patient care experience.
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine).
• Strong written English (C1+)

Responsibilities

• Evaluate clinical EHR vignettes for AI evaluation tasks.
• Score diagnostic reasoning quality across items and provide rationales.
• Review reasoning traces and ensure accuracy of answers from vignette facts.
• Contribute three blind reads per case followed by adjudication.

Skills

Strong written English

Clinical reasoning

Education

MD/DO degree

Active US medical license

Board certification or residency

Job description

Mindrift seeks physicians (MD/DO) with active US medical licenses to evaluate clinical EHR vignettes for an AI evaluation project. You will work on written cases across multiple systems, score reasoning quality, and write concise rationales.

This is a remote, task-based, independent contractor opportunity with onboarding rewards and potential quality incentives. Ideal candidates have board certification or residency, broad multi-system experience, strong clinical reasoning, and excellent written