Remote Medical AI Clinical Reasoning Evaluator

OpenTrain AI, Inc.; United States; Remote; USD 83,000 - 152,000; Part time

Job summary

OpenTrain AI, Inc. is seeking licensed physicians to participate in remote, flexible AI training evaluations. You will assess how AI systems perform on medical problems and clinical decision-making tasks, applying evidence-based medicine and your practical medical judgment.

You will work with AI researchers to clarify model strengths and gaps, design evaluation criteria, and develop clinical scenarios. Hours start at 20 per week (up to 30) for about one month, with potential extensions based on

Qualifications

• Active medical license in good standing.
• Current clinical practice experience.
• Strong foundation in evidence-based medicine.
• Excellent analytical and communication skills.

Responsibilities

• Design systematic evaluation frameworks for medical AI systems.
• Create clinical scenarios that test AI reasoning and decision-making.
• Build assessment methods grounded in clinical practice.
• Identify gaps in AI medical knowledge and clinical reasoning.
• Apply clinical judgment and evidence-based medicine to evaluate AI behavior.
• Collaborate with AI researchers to improve model performance.

Skills

Analytical thinking

Communication skills

Clinical decision-making

Evidence-based medicine

Education

Active medical license

Job description

OpenTrain AI, Inc. is seeking licensed physicians to participate in remote, flexible AI training evaluations. You will assess how AI systems perform on medical problems and clinical decision-making tasks, applying evidence-based medicine and your practical medical judgment.

You will work with AI researchers to clarify model strengths and gaps, design evaluation criteria, and develop clinical scenarios. Hours start at 20 per week (up to 30) for about one month, with potential extensions based on