Clinical AI Evaluator (MD/DO) Remote Contractor

Appsierra Group; American Samoa; On-site; USD 165,000 - 317,000; Part time

Benefits offered by this job

Fully remote

Job summary

Appsierra Group seeks a licensed MD/DO to work remotely as a contractor on a 1-month engagement, up to 30 hours per week, evaluating how AI systems handle clinical reasoning and real-world medical scenarios. Design structured evaluations, create clinical scenarios, and identify gaps in AI medical knowledge while collaborating with AI research teams to improve model performance.

This role suits physicians who enjoy evidence-based medicine, critical thinking, and applying clinical judgment to AI

Qualifications

• MD/DO licensed and in active clinical practice.
• Experience in clinical decision-making and evidence-based medicine.
• Strong critical-thinking and problem-solving skills.
• Strong analytical and communication abilities.
• Interest in how AI can support clinical practice.

Responsibilities

• Design systematic evaluation frameworks for medical AI systems.
• Create clinical scenarios that test AI reasoning and medical decision-making.
• Develop assessment methods that capture the nuance of real clinical practice.
• Identify gaps in AI medical knowledge, reasoning, and clinical performance.
• Collaborate with AI research teams to evaluate and improve model performance.

Skills

MD/DO license

Clinical decision-making

Critical thinking

Analytical skills

Communication skills

Interest in AI in medicine

Education

MD/DO

Job description

Appsierra Group seeks a licensed MD/DO to work remotely as a contractor on a 1-month engagement, up to 30 hours per week, evaluating how AI systems handle clinical reasoning and real-world medical scenarios. Design structured evaluations, create clinical scenarios, and identify gaps in AI medical knowledge while collaborating with AI research teams to improve model performance.

This role suits physicians who enjoy evidence-based medicine, critical thinking, and applying clinical judgment to AI