Remote Medical AI Evaluation Reviewer — Internal Medicine

Mindrift; Oregon; Hybrid; USD 124,000 - 152,000; Full time

Benefits offered by this job

Onboarding reward

Flexible schedule

Job summary

Mindrift is seeking actively practicing physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review cases across multiple systems, scoring reasoning quality and documenting rationales.

This is a flexible, project-based engagement with no patient contact. Contributors work 10-20 hours/week during active phases, with the ability to choose when and how much to contribute.

Qualifications

• Active, unrestricted US medical license required.
• Board certification or completed residency training.
• Broad multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes with a question, proposed answer, and distractor across multiple medical domains.
• Score clinical reasoning quality, vignette accuracy, completeness, and trap quality.
• Write short rationales and ensure reasoning traces are clear and correct.
• Participate in three blind reads followed by physician adjudication.

Skills

Strong written English

Clinical reasoning

Education

MD or DO

Active US medical license

Board certification or completed residency

Job description

Mindrift is seeking actively practicing physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review cases across multiple systems, scoring reasoning quality and documenting rationales.

This is a flexible, project-based engagement with no patient contact. Contributors work 10-20 hours/week during active phases, with the ability to choose when and how much to contribute.