Part-Time MD/DO AI Evaluation Trainer

Mindrift; México; Remote; MXN 898,000 - 1,496,000; Part time

Benefits offered by this job

Part-time projects

Freelance/Contract

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based. We’re seeking US-based physicians (MD/DO) with active licenses to evaluate clinical EHR vignettes, score reasoning quality, and provide concise rationales.

Tasks are 10–20 hours weekly and paid per accepted task. This freelance role offers a part-time schedule with independent adjudication and an opportunity to

Qualifications

• MD or DO with active US medical license
• Board certification or completed residency with recent direct patient care
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• Strong clinical reasoning and application of evidence-based guidelines
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is a plus

Responsibilities

• Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across multiple systems
• Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, trap quality, and answer correctness
• Check whether the reasoning chain reaches the answer from vignette facts alone and write short rationales
• Work within three independent blind reads, followed by physician adjudication

Skills

MD/DO license

US medical license

Board certification or residency

Broad multi-system experience

Clinical reasoning

AI evaluation experience

Medical annotation/QA

Education

MD or DO

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. Participation is project-based. We’re seeking US-based physicians (MD/DO) with active licenses to evaluate clinical EHR vignettes, score reasoning quality, and provide concise rationales.

Tasks are 10–20 hours weekly and paid per accepted task. This freelance role offers a part-time schedule with independent adjudication and an opportunity to