Part-Time Physician - AI Medical EHR Evaluation

Braintrust; Cheyenne (WY); Remote; USD 124,000 - 207,000; Part time

Job summary

Braintrust is seeking US-based physicians (MD/DO) to participate in a project-based AI evaluation program focused on medical decision-making and clinical vignettes. The work is non-permanent and part-time, offering flexible scheduling across active project phases.

Contributors will assess vignette accuracy, score clinical reasoning, write concise rationales, and participate in multiple blind reads with adjudication. Ideal for physicians seeking selective, project-based engagements.

Qualifications

• MD or DO with active, unrestricted US medical license.
• Board certification or completed residency with recent direct patient care.
• Broad, multi-system diagnostic and treatment experience.
• Strong clinical reasoning and application of evidence-based guidelines.
• Experience in medical AI evaluation or medical annotation is a plus.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractors across organ systems.
• Score the clinical reasoning quality and vignette accuracy.
• Assess whether reasoning traces lead to the answer using vignette facts.
• Provide short rationales and participate in three independent blind reads with physician adjudication.

Skills

Strong clinical reasoning

Strong written English (C1+)

Medical AI evaluation experience

Multi-system diagnostic experience

Education

MD or DO degree

Job description

Braintrust is seeking US-based physicians (MD/DO) to participate in a project-based AI evaluation program focused on medical decision-making and clinical vignettes. The work is non-permanent and part-time, offering flexible scheduling across active project phases.

Contributors will assess vignette accuracy, score clinical reasoning, write concise rationales, and participate in multiple blind reads with adjudication. Ideal for physicians seeking selective, project-based engagements.