Remote Clinical AI Evaluator - Physician Safety & Guidelines

AI Trainer Jobs; United States; Remote; USD 83,000 - 124,000; Full time

Job summary

AuraOne is seeking a Physician AI Evaluator to review AI outputs touching physician practice. You will assess clinical reasoning, dosing logic, and guideline adherence, flag safety issues, and document corrected reasoning for model training.

Active medical license and hands-on case review experience are required. Strong written reasoning and ability to apply rubrics consistently across batches are essential. Remote work with flexible hours.

Qualifications

• Active or recent license/board certification in physician or adjacent specialty.
• Hands-on clinical experience reading patient cases and writing assessments.
• Ability to apply multi-page rubrics consistently across large batches.
• Clear written reasoning citing guidelines, evidence, or standard of care.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against physician guidelines and standard of care for Physician AI Evaluator assignments.
• Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
• Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
• Capture the corrected clinical reasoning so the modeling team can train on it.
• Adjudicate disputed cases against published evidence or specialty guidelines.

Skills

Active medical license

Clinical case review

Rubric application

Written reasoning

Weekly availability

Education

Medical license/board certification

Tools

Guideline databases

Structured assessment tools

Job description

AuraOne is seeking a Physician AI Evaluator to review AI outputs touching physician practice. You will assess clinical reasoning, dosing logic, and guideline adherence, flag safety issues, and document corrected reasoning for model training.

Active medical license and hands-on case review experience are required. Strong written reasoning and ability to apply rubrics consistently across batches are essential. Remote work with flexible hours.