Remote MD/DO Clinical AI Evaluator — Hourly Contract

Appsierra Group; American Samoa; On-site; USD 193,000 - 220,000; Part time

Benefits offered by this job

Weekly payments via Stripe or Wise

Job summary

Appsierra Group is seeking residency-trained physicians to join a global expert pool for non-clinical AI evaluation work. You will contribute clinical judgment to scoring criteria, annotate reasoning, and assess AI outputs across diverse streams.

The role emphasizes structured evaluation, no live patient care, and flexible, remote engagement. Ideal candidates are MD/DO with active licenses, at least 2 years post-residency experience, and strong English writing skills.

Qualifications

• MD or DO with completed residency training in any specialty.
• Active, unrestricted medical license in your country of practice.
• 2+ years of post-residency clinical experience.
• Ability to write structured clinical rationale clearly and logically.
• Fluency in written and spoken English.
• Commit to at least 20 hours per week with project-based flexibility.

Responsibilities

• Develop grading criteria breaking clinical questions into objective standards.
• Evaluate clinical dialogues for accuracy, safety, and completeness.
• Annotate clinical reasoning including differentials and reasoning paths.
• Review AI outputs for hallucinations, omissions, and unsafe recommendations.
• Develop specialty guidelines covering standards of care and edge cases.
• Create difficult clinical questions and scenarios to test AI reasoning.
• Provide structured written feedback for evaluation teams.

Skills

Clinical reasoning

Structured writing

English fluency

Education

MD/DO degree

Residency completion

Job description

Appsierra Group is seeking residency-trained physicians to join a global expert pool for non-clinical AI evaluation work. You will contribute clinical judgment to scoring criteria, annotate reasoning, and assess AI outputs across diverse streams.

The role emphasizes structured evaluation, no live patient care, and flexible, remote engagement. Ideal candidates are MD/DO with active licenses, at least 2 years post-residency experience, and strong English writing skills.