Remote AI Medical Reviewer — Internal Medicine Clinician

DataAnnotation; Texas; Remote; USD 55,000 - 172,000; Full time

Job summary

DataAnnotation is seeking an experienced internal medicine clinician to train AI models by evaluating how models answer clinical questions and assessing reasoning. You will measure accuracy and safety, compare multiple responses, and log discrepancies, providing a clear rationale for every decision.

The role emphasizes handling complex adult disease cases, with emphasis on high-quality, well-structured clinical writing.

Qualifications

• Fluent English (native or bilingual).
• Hands-on clinical experience managing complex adult disease.
• Clear, well-organized writing.

Responsibilities

• Review AI responses with clinical context as a clinician would.
• Rate each response on accuracy, completeness, safety, and usefulness.
• Compare two independent responses and log discrepancies.
• Write a clear, detailed rationale explaining your call, including what the weaker response still got right.
• Pinpoint what model responses miss, misstate, or leave incomplete, from an incomplete differential to a missed interaction, contraindication, or red flag.

Skills

Fluency in English

Education

Board certification in internal medicine

Current license to practice internal medicine (US/UK/Canada/Australia)

Job description

DataAnnotation is seeking an experienced internal medicine clinician to train AI models by evaluating how models answer clinical questions and assessing reasoning. You will measure accuracy and safety, compare multiple responses, and log discrepancies, providing a clear rationale for every decision.

The role emphasizes handling complex adult disease cases, with emphasis on high-quality, well-structured clinical writing.