Remote Physician - AI Medical Model Evaluator (Part-Time)

Weekday

Oregon

Hybrid

USD 176,000 - 238,000

Part time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Weekday is seeking experienced MDs/DOs to contribute clinical expertise to the development and evaluation of next-generation AI healthcare models. You will assess AI-generated medical responses for accuracy, safety, and reliability across diagnosis, clinical reasoning, and patient care workflows.

Your role involves providing structured feedback, identifying critical errors, and collaborating with AI researchers to improve model performance.

Qualifications

  • Must hold an MD or DO from an accredited medical school.
  • Active and unrestricted US medical license.
  • Successful completion of residency training.
  • Currently practicing and actively involved in direct patient care.
  • 3+ years of post-residency professional experience strongly preferred.

Responsibilities

  • Evaluate AI-generated medical responses for clinical accuracy, patient safety, and adherence to established medical guidelines and standards.
  • Review outputs related to diagnosis, differential diagnosis, clinical reasoning, and treatment recommendations.
  • Score case assessments and care recommendations based on professional clinical judgment.
  • Provide structured, detailed feedback on clarity, accuracy, completeness, and clinical relevance of AI-generated responses.
  • Identify and flag critical errors and potential failure modes that could affect patient safety.
  • Assess AI performance across different medical scenarios and patient care workflows.
  • Collaborate with AI research teams to improve healthcare AI models.

Skills

Clinical expertise
Analytical thinking
Written communication
Remote work discipline

Education

MD or DO degree
Residency completed

Job description

Weekday is seeking experienced MDs/DOs to contribute clinical expertise to the development and evaluation of next-generation AI healthcare models. You will assess AI-generated medical responses for accuracy, safety, and reliability across diagnosis, clinical reasoning, and patient care workflows.

Your role involves providing structured feedback, identifying critical errors, and collaborating with AI researchers to improve model performance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Medical AI Quality Evaluator (MD/DO)
Remote Medical AI Quality Evaluator (MD/DO)

Weekday AI • United States

Remote
USD 170,000 - 243,000
Remote Physician AI Evaluator - Contract, $150/hr
Remote Physician AI Evaluator - Contract, $150/hr

Weekday • United States

Remote
USD 170,000 - 243,000
Weekly payments
Fully remote
Contractor basis
Physician AI Model Evaluator (Part-Time, US)
Physician AI Model Evaluator (Part-Time, US)

HumanitApp • United States

On-site
USD 170,000 - 243,000
Remote Orthopedic Surgeon & Medical AI Evaluator - Part-Time
Remote Orthopedic Surgeon & Medical AI Evaluator - Part-Time

Weekday AI • United States

Remote
USD 398,000 - 567,000
Health insurance
Remote MD for AI Training Evaluation - Part-Time Contractor
Remote MD for AI Training Evaluation - Part-Time Contractor

Micro1 • United States

Remote
USD 83,000 - 138,000
Remote Medical Doctor - AI Health Content Evaluator (Part-Time)
Remote Medical Doctor - AI Health Content Evaluator (Part-Time)

YO AI Labs • New York (NY)

Remote
USD 138,000 - 207,000
Remote MD for AI Review & Validation (Part-time)
Remote MD for AI Review & Validation (Part-time)

Xperteez Technology • United States

Remote
USD 83,000 - 138,000
Remote work
Remote General Physician — AI Model Evaluator (Contractor)
Remote General Physician — AI Model Evaluator (Contractor)

Benture • United States

Remote
USD 176,000 - 238,000
Physician (MD / DO), Medical AI Expert (Remote)
Physician (MD / DO), Medical AI Expert (Remote)

Weekday AI • United States

Remote
USD 170,000 - 243,000
Remote Physician Expert - AI Clinical QA (Part-Time)
Remote Physician Expert - AI Clinical QA (Part-Time)

YO AI Labs • United States

Remote
USD 165,000 - 331,000