Medical Expert (Contract)

mpathic; United States; Remote; USD 41,000 - 276,000; Part time

Job summary

mpathic is seeking contract Medical Experts to support AI safety and health information quality. This role suits clinicians who care about patient safety and health equity, with multilingual capability highly valued.

Responsibilities include roleplaying scenarios, evaluating medical accuracy of AI outputs, red teaming, and developing evaluation frameworks, all while maintaining confidentiality and collaborating with engineers and researchers.

Qualifications

• Graduate-level training in medicine, nursing, public health, or related clinical field.
• Clinical experience evaluating or managing medical conditions.
• Fluency in English and at least one additional language.
• Familiarity with AI tools, LLMs, or clinical decision-support tech.
• Willingness to sign NDAs and work with high-risk content.
• Availability up to 10 hours per week, remotely.

Responsibilities

• Roleplaying medical and health scenarios with AI agents.
• Evaluate medical accuracy, clarity, and safety of AI health info.
• Red team for edge cases, unsafe guidance, and model failure modes.
• Identify signs of distress, medical risk, or urgency escalation.
• Rate AI responses for safety and harm prevention.
• Develop rubrics, taxonomies, and evaluation frameworks.
• Qualitative analysis of AI conversations on health topics.
• Provide expert feedback on internal medical safety policies.
• Collaborate with engineers, researchers, and clinicians.
• Document edge cases, near-misses, and failure patterns.
• Maintain confidentiality and QA standards.
• Participate in interdisciplinary review and calibration.
• Adhere to ethical guidelines and safety practices.

Skills

Fluency in English and another lang

Attention to detail

Strong communication

Risk assessment

Remote collaboration

Education

Graduate-level training in medicine, nursing, public health, or related clinical field

Tools

Slack

LLM tools

Google Docs

Job description

About mpathic.ai

Keeping the human in AI.mpathic is a trusted leader in advancing clinical accuracy and quality through developing AI-enhanced solutions. mpathic offers human services in red teaming, trust & safety, central rating and monitoring for clinical trials and expert data annotation for LLM builders. Our reviewers have specialization in behavioral analysis, conversational design, mental health, psychiatry, social services and clinical trial settings.

About the Role

If you have applied for a part-time expert role within the past 12 months, you do not need to reapply.

mpathic is seeking contract Medical Experts to support confidential initiatives focused on AI safety, health information quality, and medical risk mitigation for large language models (LLMs).

This role is ideal for clinicians and medical professionals who care deeply about patient safety, health equity, and the responsible use of AI in healthcare contexts. Multilingual proficiency is critical for this role. We are especially interested in experts who can work fluently across multiple languages and cultural contexts.

What You’ll Be Doing

Responsibilities vary by project and may include:

• Roleplaying medical and health-related scenarios with AI agents
• Evaluating the medical accuracy, clarity, and safety of AI-generated health information
• Red teaming for medical edge cases, unsafe guidance, and model failure modes
• Identifying signs of patient distress, medical risk, or urgency escalation
• Rating and evaluating AI model responses for safety, appropriateness, and harm prevention
• Developing and refining medical rubrics, behavioral taxonomies, and evaluation frameworks
• Conducting qualitative analysis of AI conversations involving health topics
• Providing expert feedback on internal medical safety and health policy
• Collaborating with engineers, researchers, and clinicians on safety metrics
• Documenting edge cases, near-misses, and failure patterns
• Maintaining strict confidentiality, QA standards, and ethical guidelines
• Participating in interdisciplinary review and calibration sessions

Who You’ll Protect

• Patients seeking medical or health-related guidance
• Caregivers and family members
• Individuals with acute, chronic, or complex health conditions
• Users navigating uncertainty, anxiety, or risk related to health decisions

What We’re Looking For

Successful candidates are proactive, detail-oriented, communicative, and comfortable working at the intersection of medicine and emerging technology.

Basic Qualifications

• Graduate-level training (past or current) in medicine, nursing, public health, or a related clinical field
• Clinical experience evaluating or managing medical conditions (acute, chronic, or complex)
• Strong understanding of medical ethics, patient safety, and risk communication
• Fluency in English and at least one additional language
• Familiarity with AI tools, LLMs, or clinical decision-support technologies
• Ability to work remotely using Slack, LLM tools, and Google Docs
• Comfort with ambiguity, evolving guidelines, and feedback-driven work
• Willingness to sign NDAs and work with sensitive or high-risk content
• Availability up to 10 hours per week and for occasional scheduled meetings

Above and Beyond

• Completed degree and active licensure
• 5+ years of clinical or applied medical experience
• Experience in emergency medicine, primary care, specialty care, or public health
• Experience working with a broad range of cultures
• Background in health communication, medical education, or patient-facing content
• Trust & safety, content moderation, or medical data labeling experience
• Interest in AI, NLP, or ML applications in healthcare
• Experience reviewing or developing clinical guidelines or protocols
• Membership in online communities (e.g., Discord, Reddit, professional forums)
• Experience working across cultures or healthcare systems internationally

Pay

$30–$200/hour based on licensure and experience