Remote AI Case Review Physician — Flexible, Project-Based

Toloka; Ohio; Remote; USD 83,000 - 152,000; Full time

Benefits offered by this job

Flexible, project-based

Job summary

Mindrift is seeking actively practicing MDs/DOs with US license to evaluate clinical EHR vignettes for an AI evaluation project. Work is remote, project-based, with flexible hours around your clinical practice.

You will rate vignette quality, provide short rationales, and participate in blind reads and adjudication. Onboarding reward exists; earnings per approved task are determined by a flat rate near $100/hr equivalent.

Qualifications

• MD/DO degree or equivalent medical degree required.
• Active, unrestricted US medical license required.
• Board certification or completed residency training.
• Broad, multi-system diagnostic and treatment experience highly desirable.
• Strong clinical reasoning and ability to apply evidence-based guidelines.
• Prior experience in medical AI evaluation or medical annotation/QA is a plus.
• Excellent written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across multiple medical domains.
• Score reasoning quality, vignette accuracy, and trap quality; assess whether reasoning reaches the answer from vignette facts.
• Provide concise rationales and participate in physician adjudication processes.

Skills

Strong written English

Clinical reasoning

Education

MD/DO degree

Board certification or completed residency training

Job description

Mindrift is seeking actively practicing MDs/DOs with US license to evaluate clinical EHR vignettes for an AI evaluation project. Work is remote, project-based, with flexible hours around your clinical practice.

You will rate vignette quality, provide short rationales, and participate in blind reads and adjudication. Onboarding reward exists; earnings per approved task are determined by a flat rate near $100/hr equivalent.