Remote Physician Evaluator for AI Clinical Vignettes

Toloka; West Virginia; Remote; USD 14,000 - 28,000; Full time

Benefits offered by this job

$50 onboarding reward

Job summary

Mindrift is seeking US-licensed physicians to evaluate written clinical vignettes for an AI evaluation project. You will review case vignettes, score reasoning quality, and provide concise rationales; participation is independent contractor and project-based.

Contributors work remotely with no patient contact, and onboarding includes a $50 reward after first approved task. Board-certified or residency-trained physicians with broad multi-system experience are encouraged to apply.

Qualifications

• Medical degree (MD or DO) and active, unrestricted US medical license.
• Board certification or completed residency with direct patient care experience.
• Broad, multi-system diagnostic and treatment experience; strong clinical reasoning.

Responsibilities

• Evaluate clinical EHR vignettes for AI evaluation projects.
• Score the clinical reasoning quality of benchmark items and assess vignette accuracy and completeness.
• Write concise rationales and ensure reasoning traces are derived from vignette facts.

Skills

MD/DO degree

Active US medical license

Board certification or residency

Clinical reasoning

Written English (C1+)

Experience in medical AI evaluation/QA

Education

MD/DO (Medical degree)

Job description

Mindrift is seeking US-licensed physicians to evaluate written clinical vignettes for an AI evaluation project. You will review case vignettes, score reasoning quality, and provide concise rationales; participation is independent contractor and project-based.

Contributors work remotely with no patient contact, and onboarding includes a $50 reward after first approved task. Board-certified or residency-trained physicians with broad multi-system experience are encouraged to apply.