Remote Internal Medicine AI Evaluator & Rater

DataAnnotation; United States; Remote; USD 142,000 - 202,000; Part time

Job summary

DataAnnotation seeks experienced Internal Medicine physicians to train AI models by reviewing and scoring AI-generated clinical answers. You will assess accuracy, safety, and completeness, then justify decisions with a clear rationale and note gaps for improvement.

Applicants should be board-certified in internal medicine or hold a licensed practice, with strong English writing and attention to detail. Remote, independent contractor role with flexible hours.

Qualifications

• Board certification in internal medicine with at least 3 years of post-residency experience, or a valid license to practice internally.
• Strong clinical training with experience in assessing complex adult disease.
• Excellent written communication and attention to detail.

Responsibilities

• Review AI responses to clinical questions and contextual clinician data.
• Rate accuracy, completeness, safety, and usefulness of each answer.
• Compare two independent responses and log discrepancies.
• Provide clear, detailed rationale for decisions and identify gaps or red flags.

Skills

Clinical reasoning

Detail-oriented writing

English fluency

Education

Board-certified in Internal Medicine

Job description

DataAnnotation seeks experienced Internal Medicine physicians to train AI models by reviewing and scoring AI-generated clinical answers. You will assess accuracy, safety, and completeness, then justify decisions with a clear rationale and note gaps for improvement.

Applicants should be board-certified in internal medicine or hold a licensed practice, with strong English writing and attention to detail. Remote, independent contractor role with flexible hours.