Remote Medical AI Evaluator — Board-Certified Physician

Mindrift; Oregon; Hybrid; USD 124,000 - 152,000; Full time

Benefits offered by this job

Onboarding reward

Incentives for quality tasks

Job summary

Mindrift connects physicians with project-based AI evaluation work, focusing on testing and improving systems. You review clinical EHR vignettes for MDs with an active US license, scoring reasoning and documenting rationales.

Contributors may work 10–20 hours weekly, from anywhere, with onboarding rewards and incentives for high-quality tasks. This is a flexible, time-limited project-based opportunity.

Qualifications

• MD or DO with active US license and board cert or residency.
• Broad diagnostic and treatment experience across multiple systems.
• Strong written English and ability to review clinical cases.
• Experience in medical AI evaluation or QA is a plus.

Responsibilities

• Evaluate clinical EHR vignettes with questions, answers and distractors.
• Score clinical reasoning quality, vignette accuracy and trap quality.
• Check reasoning chains and write short rationales.
• Participate in three blind reads with physician adjudication.

Skills

Strong clinical reasoning

Broad multi-system diagnostic & tx exp

Strong written English (C1+)

Medical AI evaluation/annotation

Education

MD or DO degree

Board certification or residency training

Job description

Mindrift connects physicians with project-based AI evaluation work, focusing on testing and improving systems. You review clinical EHR vignettes for MDs with an active US license, scoring reasoning and documenting rationales.

Contributors may work 10–20 hours weekly, from anywhere, with onboarding rewards and incentives for high-quality tasks. This is a flexible, time-limited project-based opportunity.