Remote Physician AI Evaluator - Contract, $150/hr

Weekday

United States

Remote

USD 170,000 - 243,000

Part time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Weekly payments
Fully remote
Contractor basis

Job summary

Weekday is seeking experienced Medical Professionals to contribute clinical expertise to evaluating AI healthcare models. You will assess AI-generated medical responses for accuracy, safety, and reliability across diagnosis, reasoning and patient care workflows.

You will help ensure outputs meet medical standards and reflect real-world practice, while working remotely as part of a flexible, contract engagement.

Qualifications

  • MD or DO with active US license and residency completed.
  • Currently practicing and involved in direct patient care.
  • 3+ years post-residency experience preferred.
  • Specialties: Primary Care, Internal Medicine, Family Medicine, Emergency Medicine, Critical Care, Hospital-based.

Responsibilities

  • Evaluate AI-generated medical responses for clinical accuracy and safety.
  • Review outputs related to diagnosis, clinical reasoning and treatment.
  • Score case assessments using professional clinical judgment.
  • Provide structured feedback on clarity, accuracy and relevance.
  • Identify critical errors and potential patient-safety risks.
  • Assess performance across various medical scenarios and workflows.
  • Collaborate asynchronously with AI research teams to improve models.

Skills

Analytical thinking
Written communication
Attention to clinical detail

Education

MD or DO degree
US medical license
Residency completed
3+ years post-residency experience

Job description

Weekday is seeking experienced Medical Professionals to contribute clinical expertise to evaluating AI healthcare models. You will assess AI-generated medical responses for accuracy, safety, and reliability across diagnosis, reasoning and patient care workflows.

You will help ensure outputs meet medical standards and reflect real-world practice, while working remotely as part of a flexible, contract engagement.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Medical AI Quality Evaluator (MD/DO)
Remote Medical AI Quality Evaluator (MD/DO)

Weekday AI • United States

Remote
USD 170,000 - 243,000
Remote Physician for AI Clinical QA & Case Annotation
Remote Physician for AI Clinical QA & Case Annotation

YO AI Labs • New York (NY)

Remote
USD 78,000 - 120,000
Remote Medical Doctor - AI Health Content Evaluator (Part-Time)
Remote Medical Doctor - AI Health Content Evaluator (Part-Time)

YO AI Labs • New York (NY)

Remote
USD 138,000 - 207,000
Remote Healthcare & Medical Expert - Contract, 20h/wk
Remote Healthcare & Medical Expert - Contract, 20h/wk

Anyone AI • United States

Remote
USD 41,000 - 83,000
Remote work
20 hours/week
Remote Medical AI Evaluation Specialist (Part-Time, Contract)
Remote Medical AI Evaluation Specialist (Part-Time, Contract)

Jobgether • United States

Remote
USD 41,000 - 83,000
Remote work
Contract-based
Part-time (~20 hours)
Remote Orthopedic Surgeon & Medical AI Evaluator - Part-Time
Remote Orthopedic Surgeon & Medical AI Evaluator - Part-Time

Weekday AI • United States

Remote
USD 398,000 - 567,000
Health insurance
Remote Contract Medical AI Evaluator (Clinical Expert)
Remote Contract Medical AI Evaluator (Clinical Expert)

Mercor • San Francisco (CA)

Hybrid
GBP 127,000 - 181,000
Remote Medical Pro: AI Response Evaluator (Up to $300/hr)
Remote Medical Pro: AI Response Evaluator (Up to $300/hr)

OpenTrain AI, Inc. • United States

Remote
USD 341,000 - 486,000
Remote work
Part-time contract
Physician (MD / DO), Medical AI Expert (Remote)
Physician (MD / DO), Medical AI Expert (Remote)

Weekday AI • United States

Remote
USD 170,000 - 243,000
Remote Healthcare AI Task Designer & Evaluator
Remote Healthcare AI Task Designer & Evaluator

Risedatalabs • United States

Remote
USD 69,000 - 207,000