Biomedical Research AI Evaluator

AI Trainer Jobs; United States; Remote; USD 55,000 - 110,000; Full time

Benefits offered by this job

Remote work

Independent contractor

Job summary

AI Trainer Jobs is seeking a Biomedical Research AI Evaluator for a remote contractor role. You will review AI outputs in biomedical contexts, assess safety and guideline adherence, and document corrected reasoning to help improve model performance.

You must hold an active biomedical license or board certification and have hands-on clinical experience with patient cases. Flexible, async availability of at least 10 hours weekly is expected.

Qualifications

• Active or recent biomedical license or board certification is required.
• Experience reading patient cases and writing structured assessments.
• Ability to apply multi-page rubrics consistently across batches.
• Clear written reasoning citing guidelines, evidence, or standard of care.
• Reliable asynchronous availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current biomedical guidelines and standard of care.
• Grade differential reasoning, dosing, and red-flag handling on rubrics.
• Flag patient-safety issues with appropriate severity tags.
• Capture corrected clinical reasoning to train models.
• Adjudicate disputed cases using published evidence and guidelines.
• Audit batches for rubric consistency and report drift.

Skills

Clinical reasoning

Guideline review

Patient-safety assessment

Structured clinical writing

Biomedical knowledge

Medical review

Expert review

Education

Medical license/board certification

Job description

About the role

Biomedical Research AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch biomedical. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.
Biomedical AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.
Review clinical and biomedical AI outputs. Your safety judgment is the point.

Responsibilities

• Review AI outputs against current biomedical clinical guidelines and standard of care for Biomedical Research AI Evaluator assignments.
• Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
• Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
• Capture the corrected clinical reasoning so the modeling team can train on it.
• Adjudicate disputed cases against published evidence or specialty guidelines.
  Track Healthcare review Work model Remote · Independent specialist contractor Compensation Hourly rate confirmed after the interview process. Eligible from US

What you should bring

• Active or recent license / board certification in biomedical or an adjacent specialty for Biomedical Research AI Evaluator work.
• Hands-on clinical experience reading patient cases and writing structured assessments.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that cites guidelines, evidence, or standard of care.
• Reliable async availability for at least 10 hours per week.

Role signals

Example tasks

• Grade a model's differential-diagnosis reasoning on a biomedical case and write a 2-3 sentence assessment.
• Flag a dosing miscalculation with the right severity tag and corrected dose.
• Adjudicate a disputed case between two reviewers using current specialty guidelines.
• Audit a 25-case batch for rubric consistency and report drift to the program lead.

Useful experience

• Prior work as a guideline reviewer, peer reviewer, or clinical educator.
• Familiarity with AI-assisted clinical decision support and its failure modes.
• Bilingual clinical experience for non-English patient cases.

Compensation and schedule

Hourly rate confirmed after the interview process.
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Clinical reasoning
• Guideline review
• Patient-safety assessment
• Structured clinical writing
• Biomedical
• Medicine and healthcare
• AI evaluation
• Rubric writing
• Expert review

Application boundary

Creating a specialist profile records your experience and preferences. Starting role intake is a separate action that attaches this role to your candidate record.

Specialist intake

The intake preserves your chosen role, the visible terms, and source attribution for reviewer context.

• 01 Confirm profile and eligibility details.
• 02 Attach this role deliberately.
• 03 Receive a human review decision or follow-up.
  Placement timing depends on program demand and reviewer confirmation.