Psychiatry Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 103,000 - 152,000; Full time

Job summary

AI Trainer Jobs is seeking a Psychiatry Evaluation Specialist for a remote clinical-review track assessing AI outputs related to psychiatry. Reviewers evaluate reasoning, dosing logic, and guideline adherence, flag patient-safety issues, and document corrected reasoning for model improvement.

Qualified clinicians with active licensure will review case material, grade performance on a structured rubric, and contribute to high-quality, safe AI decision support systems.

Qualifications

• Active psychiatry license or board certification required.
• Experience reading patient cases and writing structured assessments.
• Familiarity with AI-assisted clinical decision support and its failure modes.

Responsibilities

• Review AI outputs against current psychiatry guidelines and standard of care.
• Grade differential reasoning, dosing, and red-flag handling on a rubric.
• Flag patient-safety issues with severity tags and document corrections.

Skills

Clinical reasoning

Guideline review

Patient safety

Structured writing

Psychiatry

Education

Active psychiatry license

Job description

Psychiatry Evaluation Specialist is a remote clinical-review track for evaluating AI outputs that touch psychiatry. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Category: Medical & Clinical AI · Pay: $75-$110 / hr · Location: Remote - US-eligible · Contractor

Psychiatry Evaluation Specialist is a remote clinical-review track for evaluating AI outputs that touch psychiatry.

Role details

About the role

Psychiatry Evaluation Specialist is a remote clinical-review track for evaluating AI outputs that touch psychiatry. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.
Psychiatry AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.
Review clinical and biomedical AI outputs. Your safety judgment is the point.

Responsibilities

• Review AI outputs against current psychiatry clinical guidelines and standard of care for Psychiatry Evaluation Specialist assignments.
• Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
• Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
• Capture the corrected clinical reasoning so the modeling team can train on it.
• Adjudicate disputed cases against published evidence or specialty guidelines.

What you should bring

• Active or recent license / board certification in psychiatry or an adjacent specialty for Psychiatry Evaluation Specialist work.
• Hands-on clinical experience reading patient cases and writing structured assessments.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that cites guidelines, evidence, or standard of care.
• Reliable async availability for at least 10 hours per week.

Role signals

Example tasks

• Grade a model's differential-diagnosis reasoning on a psychiatry case and write a 2-3 sentence assessment.
• Flag a dosing miscalculation with the right severity tag and corrected dose.
• Adjudicate a disputed case between two reviewers using current specialty guidelines.
• Audit a 25-case batch for rubric consistency and report drift to the program lead.

Useful experience

• Prior work as a guideline reviewer, peer reviewer, or clinical educator.
• Familiarity with AI-assisted clinical decision support and its failure modes.
• Bilingual clinical experience for non-English patient cases.

Compensation and schedule

Hourly rate confirmed after the interview process.
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Clinical reasoning
• Guideline review
• Patient-safety assessment
• Structured clinical writing
• Psychiatry