Remote Hospitalist Medical AI Evaluator & QA Reviewer

Toloka

Ohio

Remote

USD 131,000 - 152,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Onboarding reward
Project-based earnings
Flexible schedule

Job summary

Mindrift is seeking actively practicing physicians with a US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review vignettes, score reasoning quality, and write concise rationales.

The work is project-based and flexible, with remote participation and onboarding rewards. The role focuses on general and internal medicine, requires MD/DO with an active license, board certification or recent residency, and strong written English.

Qualifications

  • MD or DO with an active US medical license.
  • Board certification or completed residency training.
  • Broad, multi-system diagnostic and treatment experience.

Responsibilities

  • Evaluate clinical EHR vignettes with a question, a proposed answer, and a distractor 'trap' across multiple systems.
  • Score the clinical reasoning quality of benchmark items and vignette accuracy.
  • Check whether the reasoning chain reaches the answer from vignette facts and write short rationales.
  • Participate in three independent blind reads followed by physician adjudication.

Skills

Strong written English
Clinical reasoning

Education

MD or DO

Job description

Mindrift is seeking actively practicing physicians with a US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review vignettes, score reasoning quality, and write concise rationales.

The work is project-based and flexible, with remote participation and onboarding rewards. The role focuses on general and internal medicine, requires MD/DO with an active license, board certification or recent residency, and strong written English.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Physician AI Medical Evaluation Reviewer
Remote Physician AI Medical Evaluation Reviewer

Mindrift (Toloka) • United States

Remote
USD 124,000 - 152,000
Remote work
Flexible schedule
$50 onboarding reward
Remote Physician AI QA Evaluator (MD/DO)
Remote Physician AI QA Evaluator (MD/DO)

Toloka • New Mexico

Remote
USD 11,000 - 56,000
Onboarding reward ($50)
Quality incentives
Remote Physician AI Evaluation Reviewer
Remote Physician AI Evaluation Reviewer

Toloka • Ohio

Hybrid
USD 114,000 - 162,000
Flexible schedule
Onboarding reward
Performance incentives
Remote Physician AI Evaluation Reviewer (MD/DO)
Remote Physician AI Evaluation Reviewer (MD/DO)

Mindrift • Anchorage (AK)

Remote
USD 131,000 - 145,000
$50 onboarding reward
Remote Medical AI QA Reviewer (Physician) – Flexible, Project-Based
Remote Medical AI QA Reviewer (Physician) – Flexible, Project-Based

pofft Technology Inc. • Idaho

Hybrid
USD 114,000 - 162,000
Flexible schedule
Onboarding reward
Remote Physician for AI Evaluation & Case Review
Remote Physician for AI Evaluation & Case Review

Toloka • Oregon

Remote
USD 28,000 - 83,000
Remote work
Onboarding reward $50
Remote Physician AI Evaluation Specialist (MD/DO)
Remote Physician AI Evaluation Specialist (MD/DO)

Aitrainerhq • United States

Remote
USD 28,000 - 83,000
Remote work
Flexible scheduling
Onboarding reward
Remote Physician AI Evaluation Specialist
Remote Physician AI Evaluation Specialist

Toloka • Tennessee

Remote
USD 83,000 - 124,000
Onboarding reward
Remote flexibility
Remote Physician for Medical AI Evaluation & QA
Remote Physician for Medical AI Evaluation & QA

Mindrift (Toloka) • United States

Remote
USD 11,000 - 22,000
Onboarding reward $50
Remote work for US physicians
Flexible, no minimum hours
Remote Physician: AI Medical Case Reviewer
Remote Physician: AI Medical Case Reviewer

Aitrainerhq • United States

Remote
USD 34,000 - 103,000
$50 onboarding reward