Clinical AI Quality Evaluator - Physician

Mpathic; United States; On-site; USD 110,000 - 220,000; Full time

Job summary

mpathic.ai is seeking experienced physicians to evaluate and improve AI systems used in healthcare. As a Clinical Subject Matter Expert, you will design realistic clinical scenarios, assess AI-generated responses, and provide expert feedback to enhance safety, accuracy, and alignment with real-world practice.

This contract, project-based role offers collaboration with clinicians, researchers, and AI experts to influence how AI systems reason, communicate, and support clinical decision-making in

Qualifications

• Board-certified physicians with an active medical license.
• Experience in medical education, research, quality improvement, or clinical guideline development is a plus.
• Comfort with evaluating AI-generated medical content and providing structured feedback.

Responsibilities

• Create realistic patient scenarios reflecting real-world medical decision-making.
• Evaluate AI responses using structured evaluation frameworks for accuracy, safety, and quality.
• Provide actionable feedback to improve AI system performance and reliability.
• Collaborate with the research team through onboarding and calibration sessions to maintain high-quality evaluations.

Skills

Clinical judgment

Written communication

Medical evaluation

Education

Board-certified physician

Active medical license

Job description

mpathic.ai is seeking experienced physicians to evaluate and improve AI systems used in healthcare. As a Clinical Subject Matter Expert, you will design realistic clinical scenarios, assess AI-generated responses, and provide expert feedback to enhance safety, accuracy, and alignment with real-world practice.

This contract, project-based role offers collaboration with clinicians, researchers, and AI experts to influence how AI systems reason, communicate, and support clinical decision-making in