Medical AI Evaluation Specialist — Remote (Physician)

Modern MedEd LLC

San Francisco (CA)

Hybrid

USD 207,000 - 317,000

Part time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Modern MedEd LLC is seeking a physician with an active clinical practice to collaborate on evaluating AI systems that assist clinical reasoning. You will design rigorous evaluation frameworks and clinical scenarios to test AI decision-making, building methods that capture the nuances of real patient care, while identifying gaps in AI knowledge and working with AI researchers to improve model performance.

The role offers remote engagement with flexible scheduling up to 30 hours per week for an

Qualifications

  • Licensed physician in active clinical practice.
  • Experience with clinical decision-making and evidence-based medicine.
  • Interest in how AI can support clinical practice.
  • Strong analytical and communication skills.

Responsibilities

  • Design systematic evaluation frameworks for medical AI systems.
  • Create clinical scenarios that test AI reasoning and decision-making capabilities.
  • Build assessment methods that capture the nuance of clinical practice.
  • Identify gaps in AI medical knowledge and reasoning.
  • Collaborate with AI researchers to improve model performance.

Skills

Analytical thinking
Communication

Education

Medical license (MD)

Job description

Modern MedEd LLC is seeking a physician with an active clinical practice to collaborate on evaluating AI systems that assist clinical reasoning. You will design rigorous evaluation frameworks and clinical scenarios to test AI decision-making, building methods that capture the nuances of real patient care, while identifying gaps in AI knowledge and working with AI researchers to improve model performance.

The role offers remote engagement with flexible scheduling up to 30 hours per week for an

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Clinical AI Evaluator (Remote, Part-Time)
Clinical AI Evaluator (Remote, Part-Time)

Modern MedEd LLC • United States

Remote
USD 124,000 - 207,000
Clinical AI Evaluator for Medical Reasoning (Remote, Part-Time)
Clinical AI Evaluator for Medical Reasoning (Remote, Part-Time)

Turing • United States

Remote
USD 165,000 - 248,000
Remote work
Flexible scheduling
Physician - AI Medical Evaluation Specialist (Part-Time)
Physician - AI Medical Evaluation Specialist (Part-Time)

Mindrift (Toloka) • United States

Remote
USD 83,000 - 179,000
Remote Physician: AI Clinical Reasoning Evaluator
Remote Physician: AI Clinical Reasoning Evaluator

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 100,000 - 167,000
Referral Bonus
Remote Medical AI Clinical Reasoning Evaluator
Remote Medical AI Clinical Reasoning Evaluator

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 152,000
Part-Time MD for AI Training & Medical Evaluation (Remote)
Part-Time MD for AI Training & Medical Evaluation (Remote)

micro1 Inc. • United States

Remote
USD 55,000 - 124,000
Remote MD/DO Medical AI Evaluation Specialist
Remote MD/DO Medical AI Evaluation Specialist

Toloka • Ohio

Remote
USD 25,000 - 60,000
Onboarding reward
Quality incentives
Remote Physician for AI Medical Training & Evaluation
Remote Physician for AI Medical Training & Evaluation

Frontier AI Lab • United States

Remote
USD 83,000 - 165,000
Medical Doctor - Remote
Medical Doctor - Remote

YO AI Labs • New York (NY)

Remote
USD 138,000 - 207,000
Remote Clinical AI Evaluator — Medical AI Specialist
Remote Clinical AI Evaluator — Medical AI Specialist

Medix Staffing Solutions, Inc. • United States

Remote
USD 55,000 - 90,000