US Physician AI Evaluation Specialist (MD/DO) — Part-Time

Mindrift; New York (NY); Remote; USD 55,000 - 96,000; Part time

Job summary

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. Tasks include scoring reasoning, writing short rationales, and adjudication, with about 10–20 hours weekly and paid per accepted task up to $70/hr. This engagement is part-time and flexible for clinicians seeking project-based work.

Qualifications

• MD or DO with active, unrestricted US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and application of guidelines.
• Experience in medical AI evaluation or medical annotation is a plus.
• Excellent written English.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors.
• Score clinical reasoning quality and benchmark item performance.
• Check whether reasoning chains reach the answer from vignette facts and write concise rationales.
• Participate in three independent reviews followed by physician adjudication.

Skills

Clinical evaluation

Diagnostic reasoning

Medical knowledge

Written English

Education

MD/DO

Board certification or completed residency

Job description

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

We’re seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. Tasks include scoring reasoning, writing short rationales, and adjudication, with about 10–20 hours weekly and paid per accepted task up to $70/hr. This engagement is part-time and flexible for clinicians seeking project-based work.