Critical Care Physician for Clinical AI Evaluation

AuraOne Human Data; United States; Remote; USD 227,000 - 324,000; Part time

Job summary

AuraOne, Inc. is seeking a Critical Care Physician for Clinical AI Evaluation to remotely review AI outputs in regulated workflows. You will grade differential reasoning, dosing logic, and guideline adherence, and document corrected clinical reasoning to inform model improvements.

The contractor role requires medical licensure, hands-on case review experience, and reliable async availability for at least 10 hours per week; compensation is $200 per hour.

Qualifications

• Active or recent license / board certification in physician or an adjacent specialty for Critical Care Physician for Clinical AI Evaluation work.
• Hands-on clinical experience reading patient cases and writing structured assessments.
• Clear written reasoning that cites guidelines, evidence, or standard of care.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current physician clinical guidelines and standard of care for Critical Care Physician for Clinical AI Evaluation assignments.
• Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
• Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
• Capture the corrected clinical reasoning so the modeling team can train on it.
• Adjudicate disputed cases against published evidence or specialty guidelines.
• Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Skills

Clinical reasoning

Guideline review

Patient-safety assessment

Structured clinical writing

Physician

Job description

Critical Care Physician for Clinical AI Evaluation is a remote clinical-review track for evaluating AI outputs that touch physician. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

Physician AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

• Review AI outputs against current physician clinical guidelines and standard of care for Critical Care Physician for Clinical AI Evaluation assignments.
• Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
• Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
• Capture the corrected clinical reasoning so the modeling team can train on it.
• Adjudicate disputed cases against published evidence or specialty guidelines.
• Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

• Active or recent license / board certification in physician or an adjacent specialty for Critical Care Physician for Clinical AI Evaluation work.
• Hands-on clinical experience reading patient cases and writing structured assessments.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that cites guidelines, evidence, or standard of care.
• Reliable async availability for at least 10 hours per week.

Example tasks

• Grade a model's differential-diagnosis reasoning on a physician case and write a 2-3 sentence assessment.
• Flag a dosing miscalculation with the right severity tag and corrected dose.
• Adjudicate a disputed case between two reviewers using current specialty guidelines.
• Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

• Prior work as a guideline reviewer, peer reviewer, or clinical educator.
• Familiarity with AI-assisted clinical decision support and its failure modes.
• Bilingual clinical experience for non-English patient cases.

Skills

• Clinical reasoning
• Guideline review
• Patient-safety assessment
• Structured clinical writing
• Physician

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$200 / hr

Active or recent license / board certification in physician or an adjacent specialty for Critical Care Physician for Clinical AI Evaluation work. Hands-on clinical experience reading patient cases and writing structured assessments. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that cites guidelines, evidence, or standard of care. Reliable async availability for at least 10 hours per week.