Part-Time Medical AI Evaluator (MD/DO)

Mindrift; North Carolina; On-site; USD 80,000 - 113,000; Part time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. You will score reasoning quality, assess vignette accuracy, and write concise rationales. Tasks are part-time, project-based, with around 10–20 hours weekly during active phases.

Compensation is per accepted task, with pay up to $70 per hour depending on qualification tier and efficiency. This is ideal for clinicians seeking flexible, project-based work and opportunities to shape AI

Qualifications

• MD/DO with active US medical license and board certification.
• Multi-system diagnostic and treatment experience across internal, family, emergency or hospital medicine.
• Strong written English (C1+).
• Willing to participate in part-time, project-based engagements.

Responsibilities

• Evaluate clinical EHR vignettes with questions, proposed answers and distractors.
• Score the clinical reasoning quality, vignette accuracy, and trap quality.
• Check reasoning traces and write short rationales.
• Collaborate through blind reads and physician adjudication to improve AI tools.

Skills

Clinical reasoning

Strong written English

Medical AI evaluation experience

Education

MD/DO degree

US medical license (active)

Board certification or residency completed

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. You will score reasoning quality, assess vignette accuracy, and write concise rationales. Tasks are part-time, project-based, with around 10–20 hours weekly during active phases.

Compensation is per accepted task, with pay up to $70 per hour depending on qualification tier and efficiency. This is ideal for clinicians seeking flexible, project-based work and opportunities to shape AI