AI-Savvy Healthcare Systems Evaluator for Clinical Ops

mpathic; United States; Remote; USD 110,000 - 193,000; Part time

Job summary

mpathic.ai is seeking an experienced healthcare systems expert to evaluate and improve AI models that support clinical operations and healthcare technology. You will review real-world scenarios, assess AI responses, and provide actionable feedback to enhance reliability for providers, staff, and patients.

You will work on interoperability, data management concepts, and adherence to HIPAA and CMS requirements, contributing to safer, more trustworthy AI in healthcare.

Qualifications

• 5+ years in healthcare operations, healthcare technology, health information management, clinical informatics, revenue cycle, or related role.
• Strong understanding of healthcare workflows across hospitals, health systems, ambulatory care, or specialty practices.
• Experience with EHR platforms such as Epic, Cerner/Oracle Health, Meditech, athenahealth, or similar.
• Familiarity with interoperability standards, including HL7, FHIR, CCD/C-CDA, or other health data exchange frameworks.
• Knowledge of HIPAA and CMS requirements and their impact on operations.
• Strong written English and ability to communicate complex operational and technical concepts clearly.
• Exceptional attention to detail and sound judgment when evaluating AI-generated content.

Responsibilities

• Evaluate AI-generated responses for accuracy, completeness, and alignment with real-world healthcare operations.
• Review scenarios involving EHRs, clinical documentation, care coordination, scheduling, referrals, revenue cycle, or patient access workflows.
• Assess AI outputs for compliance with healthcare regulations and industry standards.
• Apply structured evaluation guidelines to annotate model responses and identify errors or improvements.
• Provide clear, actionable feedback to improve AI performance across workflows.
• Evaluate AI handling of interoperability and health information exchange concepts.
• Bring real-world experience to shape safer AI systems for healthcare.

Skills

Healthcare operations

Healthcare technology

Clinical informatics

Revenue cycle

Healthcare systems

Tools

Epic

Cerner

Meditech

athenahealth

Job description

mpathic.ai is seeking an experienced healthcare systems expert to evaluate and improve AI models that support clinical operations and healthcare technology. You will review real-world scenarios, assess AI responses, and provide actionable feedback to enhance reliability for providers, staff, and patients.

You will work on interoperability, data management concepts, and adherence to HIPAA and CMS requirements, contributing to safer, more trustworthy AI in healthcare.