Remote Medical AI Evaluator & Clinical Reasoning Specialist

OpenTrain AI, Inc.; United States; Remote; USD 55,000 - 110,000; Part time

Job summary

OpenTrain AI, Inc. is seeking an AI Evaluator (English), Resident Medical Specialist (MD/DO) to assess how AI systems handle clinical reasoning by creating medical cases and testing models. This remote freelance, part-time role requires 20+ hours per week and starts with a one-month term.

You will design evaluation frameworks, create clinical scenarios, and work with AI researchers to improve model performance, applying clinical decision-making and evidence-based medicine in practice.

Qualifications

• Must hold MD or DO license in active clinical practice
• Strong ability to evaluate AI reasoning with clinical context
• Excellent analytical and problem-solving skills

Responsibilities

• Design structured evaluation frameworks for medical AI systems
• Create clinical scenarios to test reasoning and decision-making
• Build assessments reflecting the complexity of clinical practice
• Identify gaps in medical knowledge and reasoning shown by AI systems
• Collaborate with AI researchers to improve model performance

Skills

Analytical thinking

Communication skills

Clinical decision-making

Medical knowledge

Problem-solving

Education

MD/DO

Job description

OpenTrain AI, Inc. is seeking an AI Evaluator (English), Resident Medical Specialist (MD/DO) to assess how AI systems handle clinical reasoning by creating medical cases and testing models. This remote freelance, part-time role requires 20+ hours per week and starts with a one-month term.

You will design evaluation frameworks, create clinical scenarios, and work with AI researchers to improve model performance, applying clinical decision-making and evidence-based medicine in practice.