Remote Physician for Medical AI Evaluation & QA

Mindrift (Toloka); United States; Remote; USD 11,000 - 22,000; Part time

Benefits offered by this job

Onboarding reward $50

Remote work for US physicians

Flexible, no minimum hours

Job summary

Mindrift is seeking US-licensed physicians (MD/DO) to participate in a flexible, task-based AI evaluation project. You will review written clinical EHR vignettes, assess diagnostic and treatment reasoning, and provide short rationales.

This is a remote, contractor role with no patient contact and no malpractice exposure. Earnings are per approved task, with a $50 onboarding reward after your first approved task, and potential quality incentives.

Qualifications

• Active, unrestricted US medical license (verified at onboarding and monthly)
• Board certification or completed residency with direct patient care experience
• Multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• Strong clinical reasoning and application of evidence-based guidelines
• Experience in medical AI evaluation or medical annotation/QA is a plus
• Excellent written English (C1+)

Responsibilities

• Evaluate written clinical EHR vignettes for AI evaluation projects across multiple medical domains.
• Score clinical reasoning quality, vignette accuracy, and trap quality.
• Write brief rationales and ensure reasoning traces are complete and coherent.

Skills

Strong written English

Education

MD/DO degree

Job description

Mindrift is seeking US-licensed physicians (MD/DO) to participate in a flexible, task-based AI evaluation project. You will review written clinical EHR vignettes, assess diagnostic and treatment reasoning, and provide short rationales.

This is a remote, contractor role with no patient contact and no malpractice exposure. Earnings are per approved task, with a $50 onboarding reward after your first approved task, and potential quality incentives.