Remote Physician AI Evaluation Expert

Synthires

New York (NY)

Remote

USD 179,000 - 248,000

Full time

18 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Synthires is seeking experienced Medical Experts and Physicians for remote, asynchronous evaluation of AI medical outputs. You will design realistic patient scenarios, create reference responses, and evaluate AI reasoning with evidence-based standards.

Roles are hourly contracts in the United States/Canada, with a typical commitment of 20+ hours per week and weekly payments. Board certification and a current license are required.

Qualifications

  • Attending Physicians: must be board certified with a current, active, unrestricted medical license.
  • Residents: final year of residency; recent graduates must be board-eligible.
  • Fellows: board-certified or board-eligible with active license.
  • Strong clinical reasoning and evidence-based medical decision-making skills.
  • Excellent written communication with exceptional attention to detail.
  • Ability to work independently in a fully remote, asynchronous environment.

Responsibilities

  • Design clinically realistic prompts and patient scenarios based on your medical specialty.
  • Develop high-quality reference responses demonstrating attending-level clinical reasoning.
  • Evaluate and grade AI-generated medical responses using structured evaluation criteria.
  • Assess diagnostic reasoning, treatment planning, risk stratification, and guideline adherence.
  • Provide detailed written feedback to improve the accuracy, safety, and quality of AI-generated medical outputs.
  • Participate in onboarding and specialty calibration sessions to ensure consistent evaluation standards.

Skills

Board certification
Board eligibility
Clinical reasoning
Written communication
Remote work ability

Job description

Synthires is seeking experienced Medical Experts and Physicians for remote, asynchronous evaluation of AI medical outputs. You will design realistic patient scenarios, create reference responses, and evaluate AI reasoning with evidence-based standards.

Roles are hourly contracts in the United States/Canada, with a typical commitment of 20+ hours per week and weekly payments. Board certification and a current license are required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Attending Physician – AI Medical Evaluator
Remote Attending Physician – AI Medical Evaluator

Synthires • United States

Remote
USD 179,000 - 248,000
Remote Attending Physician for AI Medical Evaluation
Remote Attending Physician for AI Medical Evaluation

Synthires • United States

Remote
USD 179,000 - 248,000
Weekly payments
Remote work
Remote AI Medical Reviewer & Case Designer (Physician)
Remote AI Medical Reviewer & Case Designer (Physician)

Synthires • United States

Remote
USD 179,000 - 248,000
Remote Physician AI Evaluator - Contract, $150/hr
Remote Physician AI Evaluator - Contract, $150/hr

Weekday • United States

Remote
USD 170,000 - 243,000
Weekly payments
Fully remote
Contractor basis
Remote Physician: AI Clinical Reasoning Evaluator
Remote Physician: AI Clinical Reasoning Evaluator

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 100,000 - 167,000
Referral Bonus
Remote Neurologist - AI Clinical Accuracy Evaluator
Remote Neurologist - AI Clinical Accuracy Evaluator

Synthires • United States

Remote
USD 227,000 - 324,000
Flexible hours
Fully remote engagement
Immediate start
Remote Physician for AI Medical Training & Evaluation
Remote Physician for AI Medical Training & Evaluation

Frontier AI Lab • United States

Remote
USD 83,000 - 165,000
Remote Clinical AI Quality Evaluator (Hourly Contract)
Remote Clinical AI Quality Evaluator (Hourly Contract)

Synthires • United States

Remote
USD 110,000 - 165,000
Remote Medical Doctor - AI Health Content Evaluator (Part-Time)
Remote Medical Doctor - AI Health Content Evaluator (Part-Time)

YO AI Labs • New York (NY)

Remote
USD 138,000 - 207,000
Remote Physician for AI Clinical Review (Part-Time)
Remote Physician for AI Clinical Review (Part-Time)

YO AI Labs • New York (NY)

Remote
USD 96,000 - 165,000