Physician AI Evaluation Reviewer (MD/DO) - Part-Time

Mindrift; New York (NY); Remote; USD 80,000 - 113,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based. This opportunity suits US-based physicians open to part-time, non-permanent projects.

Tasks include evaluating EHR vignettes, scoring reasoning, and writing concise rationales, with compensation up to $70 per hour. Working through independent blind reads and adjudication helps advance real-world AI tools you could

Qualifications

• MD or DO with active US medical license
• Board certification or completed residency with recent direct patient care
• Broad multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)

Responsibilities

• Evaluate clinical EHR vignettes with a question, a proposed answer, and a distractor "trap" across multiple systems
• Score the clinical reasoning quality of benchmark items and trap quality
• Check whether the reasoning chain reaches the answer from vignette facts and write short rationales
• Participate in three independent blind reads followed by physician adjudication

Skills

English proficiency

Clinical reasoning

Medical license

Education

MD or DO

Tools

EHR review

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based. This opportunity suits US-based physicians open to part-time, non-permanent projects.

Tasks include evaluating EHR vignettes, scoring reasoning, and writing concise rationales, with compensation up to $70 per hour. Working through independent blind reads and adjudication helps advance real-world AI tools you could