Clinical AI Evaluation Specialist (MD/DO) – Part-Time

Mindrift; Missouri; Remote; USD 114,000 - 162,000; Part time

Benefits offered by this job

Flexible, project-based engagement

Part-time hours (10–20/week)

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We're looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

Contributors may score the clinical reasoning quality, verify that the reasoning follows vignette facts, and write succinct rationales. Tasks are 10–20 hours weekly, with compensation up to $100/hr.

Qualifications

• Medical degree (MD or DO) and active US medical license.
• Board certification or completed residency with recent direct patient care.
• Strong written English (C1+) and multi-system clinical experience.

Responsibilities

• Evaluate clinical EHR vignettes and score reasoning quality.
• Write short rationales and check reasoning traces.
• Work within three blind reads with physician adjudication.

Skills

Medical license (US)

Board certification / residency

Clinical reasoning

Experience in medical AI evaluation

Written English (C1+)

Education

MD or DO

Tools

Annotation tools

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We're looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program.

Contributors may score the clinical reasoning quality, verify that the reasoning follows vignette facts, and write succinct rationales. Tasks are 10–20 hours weekly, with compensation up to $100/hr.