Remote AI Evaluation Physician - Flexible, Task-Based

Toloka; Maryland; Remote; USD 83,000 - 165,000; Part time

Benefits offered by this job

Flexible hours

Remote work (US)

Onboarding reward

Job summary

Mindrift is seeking physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for an AI evaluation project. General and internal medicine are the focus; each task is a written case assessed against the project’s acceptance criteria.

This is a flexible, time-limited remote contractor role with no patient contact or malpractice exposure. You review cases and earn fixed rates per task, with onboarding rewards and quality-based incentives.

Qualifications

• Medical degree (MD or DO) with active, unrestricted US license.
• Board certification or completed residency with direct patient care (attending-level preferred).
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning and application of guidelines.
• Prior experience in medical AI evaluation or medical annotation a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes for AI evaluation projects.
• Score vignette accuracy, completeness, and trap quality.
• Check reasoning traces and write brief rationales.
• Review cases across multiple organ systems.
• Contribute to independent reads and physician adjudication rounds.

Skills

Clinical reasoning

Written English

Education

MD or DO degree

Board certification or residency training

Job description

Mindrift is seeking physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for an AI evaluation project. General and internal medicine are the focus; each task is a written case assessed against the project’s acceptance criteria.

This is a flexible, time-limited remote contractor role with no patient contact or malpractice exposure. You review cases and earn fixed rates per task, with onboarding rewards and quality-based incentives.