Psychiatry Specialist (Contract)

mpathic; United States; Remote; USD 110,000 - 165,000; Part time

Job summary

mpathic.ai is seeking experienced psychiatrists to help evaluate and improve the next generation of large language models by testing how they reason through complex psychiatric cases. You will create challenging, clinically realistic scenarios that push AI beyond straightforward textbook knowledge.

You'll identify where models break down, develop expert reference answers grounded in evidence-based psychiatric practice, and provide structured feedback that directly improves model

Qualifications

• MD, DO, or internationally equivalent medical degree.
• Completion of an accredited psychiatry residency.
• Current board certification in Psychiatry (ABPN, FRCPC, MRCPsych, FRANZCP, or recognized national equivalent).
• Current, active, unrestricted medical license with no suspension, revocation, or ongoing disciplinary action.
• At least 3 years of independent clinical practice following residency (training years excluded).
• Experience practicing in an accredited or government-licensed healthcare setting, including hospitals, academic medical centers, community mental health clinics, private practice, or telepsychiatry.

Responsibilities

• Design clinically realistic prompts and case scenarios based on your psychiatry practice.
• Evaluate AI-generated responses using structured rubrics for accuracy, safety, completeness, and clinical judgment.
• Identify nuanced edge cases, challenging differential diagnoses, and common model failure modes to improve AI reasoning.
• Collaborate with researchers at a leading AI lab to advance healthcare AI systems.
• Provide detailed written feedback that informs future model training and evaluation.
• Participate in onboarding, calibration sessions, and ongoing quality reviews.

Skills

Direct patient care

OSCE experience

Telepsychiatry

Education

MD/DO or international equivalent medical degree

ACGME/AOA psychiatry residency

Board certification in Psychiatry

Active, unrestricted medical license

Job description

About mpathic.ai

mpathic is keeping humans safe in the AI era through automated tools and expert datasets that are rooted in psychology and powered by clinicians. We are a series A start-up backed by Tier 1 investors including Foundry.vc and Next Frontier Capital.

If you have applied for an expert role within the past 12 months, you do not need to reapply.

About the role

We're looking for experienced psychiatrists to help evaluate and improve the next generation of large language models by testing how they reason through complex psychiatric cases. In this role, you'll create challenging, clinically realistic scenarios that push AI beyond straightforward textbook knowledge. You'll identify where models break down, develop expert reference answers grounded in evidence-based psychiatric practice, and provide structured feedback that directly improves model performance. Your expertise will help shape safer, more reliable AI for healthcare.

What You'll Do

• Design clinically realistic prompts and case scenarios based on your psychiatry practice, including diagnostic formulation, medication management, psychotherapy, risk assessment, capacity evaluation, and complex clinical decision-making.
• Evaluate AI-generated responses using structured rubrics for accuracy, safety, completeness, and clinical judgment.
• Identify nuanced edge cases, challenging differential diagnoses, and common model failure modes to improve AI reasoning.
• Collaborate with researchers at a leading AI lab to advance the performance and reliability of healthcare AI systems.
• Provide detailed written feedback that informs future model training and evaluation.
• Participate in onboarding, calibration sessions, and ongoing quality reviews.

Qualifications

• MD, DO, or internationally equivalent medical degree.
• Completion of an accredited psychiatry residency (ACGME, AOA, or recognized international equivalent).
• Current board certification in Psychiatry (ABPN, FRCPC, MRCPsych, FRANZCP, or recognized national equivalent).
• Current, active, unrestricted medical license with no suspension, revocation, or ongoing disciplinary action.
• At least 3 years of independent clinical practice following residency (training years excluded), either currently practicing or having practiced within the past two years.
• Experience practicing in an accredited or government-licensed healthcare setting, including hospitals, academic medical centers, community mental health clinics, private practice, or telepsychiatry.

Nice to have

• Currently providing at least 10 hours of direct patient care per week.
• Advanced expertise in Addiction Psychiatry, Child & Adolescent Psychiatry, Consultation-Liaison Psychiatry, Forensic Psychiatry, Geriatric Psychiatry, or another recognized psychiatry subspecialty through fellowship training, subspecialty board certification, or at least two years of focused clinical practice.
• Experience developing or examining Objective Structured Clinical Examinations (OSCEs).
• Passion for improving AI systems and advancing the future of responsible healthcare technology.

Compensation

This is a contract, project-based position. The hourly rate will depend on experience and project parameters. The rate will be disclosed prior to starting the project.