Remote Physician Evaluator for AI Medical QA

Toloka; Tennessee; Remote; USD 5,000 - 10,000; Full time

Benefits offered by this job

Onboarding reward

Job summary

Toloka seeks licensed US physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation project. You review cases, score reasoning quality, and write concise rationales. All tasks are written cases with fixed task rates and a remote, flexible schedule.

Onboarding rewards are provided, and contributors review cases without patient contact. Ideal candidates hold an active US medical license, board certification or residency with direct patient care, and strong English writing skills.

Qualifications

• Must hold an active, unrestricted US medical license.
• Board certification or completed residency with direct patient care experience.
• Strong written English (C1+).

Responsibilities

• Evaluate clinical EHR vignettes for AI evaluation tasks.
• Score clinical reasoning quality and vignette accuracy.
• Write short rationales and document reasoning traces.

Skills

MD or DO

Active US medical license

Strong written English

Clinical reasoning

Education

MD/DO degree

Board certification or residency

Job description

Toloka seeks licensed US physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation project. You review cases, score reasoning quality, and write concise rationales. All tasks are written cases with fixed task rates and a remote, flexible schedule.

Onboarding rewards are provided, and contributors review cases without patient contact. Ideal candidates hold an active US medical license, board certification or residency with direct patient care, and strong English writing skills.