Multilingual Medical Safety Expert (Remote Contract)

mpathic; United States; Remote; USD 41,000 - 276,000; Part time

Job summary

mpathic is seeking contract Medical Experts to support AI safety and health information quality. This role suits clinicians who care about patient safety and health equity, with multilingual capability highly valued.

Responsibilities include roleplaying scenarios, evaluating medical accuracy of AI outputs, red teaming, and developing evaluation frameworks, all while maintaining confidentiality and collaborating with engineers and researchers.

Qualifications

• Graduate-level training in medicine, nursing, public health, or related clinical field.
• Clinical experience evaluating or managing medical conditions.
• Fluency in English and at least one additional language.
• Familiarity with AI tools, LLMs, or clinical decision-support tech.
• Willingness to sign NDAs and work with high-risk content.
• Availability up to 10 hours per week, remotely.

Responsibilities

• Roleplaying medical and health scenarios with AI agents.
• Evaluate medical accuracy, clarity, and safety of AI health info.
• Red team for edge cases, unsafe guidance, and model failure modes.
• Identify signs of distress, medical risk, or urgency escalation.
• Rate AI responses for safety and harm prevention.
• Develop rubrics, taxonomies, and evaluation frameworks.
• Qualitative analysis of AI conversations on health topics.
• Provide expert feedback on internal medical safety policies.
• Collaborate with engineers, researchers, and clinicians.
• Document edge cases, near-misses, and failure patterns.
• Maintain confidentiality and QA standards.
• Participate in interdisciplinary review and calibration.
• Adhere to ethical guidelines and safety practices.

Skills

Fluency in English and another lang

Attention to detail

Strong communication

Risk assessment

Remote collaboration

Education

Graduate-level training in medicine, nursing, public health, or related clinical field

Tools

Slack

LLM tools

Google Docs

Job description

mpathic is seeking contract Medical Experts to support AI safety and health information quality. This role suits clinicians who care about patient safety and health equity, with multilingual capability highly valued.

Responsibilities include roleplaying scenarios, evaluating medical accuracy of AI outputs, red teaming, and developing evaluation frameworks, all while maintaining confidentiality and collaborating with engineers and researchers.