Remote Medical AI QA Reviewer (Physician) – Flexible, Project-Based

pofft Technology Inc.; Idaho; Hybrid; USD 114,000 - 162,000; Full time

Benefits offered by this job

Flexible schedule

Onboarding reward

Job summary

Mindrift is seeking actively practicing physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You’ll review cases without patient contact, scoring reasoning quality and completeness while contributing to AI tool improvement.

The role offers flexible, project-based participation with 10–20 hours per week during active phases.

Qualifications

• MD or DO with an active, unrestricted US medical license.
• Board certification or recent residency with direct patient care.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and application of evidence-based guidelines.
• Experience in medical AI evaluation or annotation is a plus.

Responsibilities

• Evaluate EHR vignettes with questions, a proposed answer, and a distractor “trap” across diagnoses and treatments.
• Score vignette accuracy, completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality.
• Check reasoning chains reach the answer from vignette facts and write short rationales.
• Work within three independent blind reads, followed by physician adjudication.

Skills

Quality Assurance

Active US medical license

Board certification / residency

Education

MD or DO

Job description

Mindrift is seeking actively practicing physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You’ll review cases without patient contact, scoring reasoning quality and completeness while contributing to AI tool improvement.

The role offers flexible, project-based participation with 10–20 hours per week during active phases.