Part-Time Remote Medical AI Evaluation Specialist

24-MAG; New York (NY); Remote; USD 96,000 - 165,000; Part time

Benefits offered by this job

Remote work

Job summary

24-MAG LLC seeks licensed physicians in active clinical practice for a part-time remote engagement to evaluate medical AI through clinical reasoning, scenario development, and model performance reviews.

Selected physicians will collaborate with research teams to develop evaluation methods and benchmarks reflecting evidence-based practice, with flexible scheduling and project-based terms.

Qualifications

• Licensed physician currently in active clinical practice.
• MD, DO, or equivalent medical qualification.
• Physicians from any medical specialty may be considered.
• Ability to assess clinical decision-making objectively.

Responsibilities

• Clinical Reasoning Evaluation: evaluate AI performance on medical problems and assess reasoning quality.
• Clinical Scenario Development: design realistic cases testing nuanced clinical judgment.
• Evaluation Framework Design: create structured evaluation criteria for clinical practice.
• Medical Knowledge & Decision Analysis: review concepts, diagnoses and treatments with evidence-based reasoning.
• Research Collaboration & Feedback: provide actionable input to improve model performance.

Skills

Clinical decision-making

Evidence-based medicine

Critical thinking

Written communication

Verbal communication

Remote collaboration

Education

MD/DO or equivalent

Job description

24-MAG LLC seeks licensed physicians in active clinical practice for a part-time remote engagement to evaluate medical AI through clinical reasoning, scenario development, and model performance reviews.

Selected physicians will collaborate with research teams to develop evaluation methods and benchmarks reflecting evidence-based practice, with flexible scheduling and project-based terms.