Part-Time Physician: Medical AI EHR Vignette Evaluator

Braintrust; Oklahoma City (OK); Remote; USD 83,000 - 138,000; Part time

Job summary

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, focusing on general and internal medicine. This is a project-based role, not permanent employment, with an expected 10-20 hours per week during active phases.

Responsibilities include evaluating vignette tasks across multiple systems, scoring reasoning quality, writing brief rationales, and participating in three blind reads followed by physician adjudication.

Qualifications

• MD or DO with an active US medical license.
• Board certification or residency with recent direct patient care.
• Broad multi-system diagnostic and treatment experience.
• Strong clinical reasoning and adherence to guidelines.
• Prior AI evaluation or medical annotation experience is a plus.
• Excellent written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions and distractors.
• Score reasoning quality, vignette accuracy, and trap quality.
• Write short rationales explaining reasoning.
• Participate in three independent blind reads followed by adjudication.

Skills

Strong written English (C1+)

Clinical reasoning

Multi-system medical experience

Education

MD/DO degree

Active US medical license

Board certification or completed residency training

Job description

Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, focusing on general and internal medicine. This is a project-based role, not permanent employment, with an expected 10-20 hours per week during active phases.

Responsibilities include evaluating vignette tasks across multiple systems, scoring reasoning quality, writing brief rationales, and participating in three blind reads followed by physician adjudication.