Clinical AI Evaluation Specialist — Primary Care

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 110,000 - 393,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a part-time contractor to review healthcare content used in AI training. You will assess primary care and general medicine scenarios for accuracy, clarity, and adherence to evidence-based practice, and provide structured evaluations.

The role requires professional experience in primary care or related clinical field, with strong analytic and communication skills. Work is paid hourly, based in the United States, with at least 20 hours per week.

Qualifications

• Knowledge: patient assessment, diagnosis, clinical reasoning, treatment planning, current guidelines, and evidence-based medicine.
• Role requires ability to review and annotate medical scenarios for AI training.
• Excellent written and verbal communication in English essential.

Responsibilities

• Review patient scenarios, histories, symptoms, and findings.
• Assess differential diagnoses and next steps.
• Evaluate treatment approaches against current guidelines.
• Identify incorrect, unclear, or potentially misleading medical information.
• Provide feedback grounded in clinical expertise and evidence-based practice.

Skills

Analytical skills

Attention to detail

Clear written and verbal communication

Clinical reasoning

Patient assessment

Education

Medical degree or equivalent (preferred)

Tools

Data labeling tools

Annotation tools

AI model evaluation

Job description

OpenTrain AI, Inc. is seeking a part-time contractor to review healthcare content used in AI training. You will assess primary care and general medicine scenarios for accuracy, clarity, and adherence to evidence-based practice, and provide structured evaluations.

The role requires professional experience in primary care or related clinical field, with strong analytic and communication skills. Work is paid hourly, based in the United States, with at least 20 hours per week.