Clinical AI Evaluator — Remote Contractor

HumanitApp; United States; Remote; USD 114,000 - 162,000; Part time

Job summary

Turing invites Healthcare Experts to join projects that fine-tune AI models. If you enjoy applying clinical knowledge, analyzing complex medical scenarios, and providing clear, structured feedback, this is your chance to put your expertise to work in a new way.

Your healthcare experience will help shape how AI understands medical topics and patient care. The engagement is a contractor role with a total commitment of 40 hours spread over 4 weeks.

Qualifications

• 3+ years of clinical experience; medical administration or healthcare operations experience is preferred.
• Strong clinical reasoning and understanding of healthcare workflows.
• Excellent written communication and attention to detail.
• Prior experience in AI annotation is a plus.

Responsibilities

• Review and evaluate AI-generated responses to medical and healthcare scenarios.
• Apply a structured rubric to assess clinical accuracy, reasoning, completeness, and patient-safety considerations.
• Identify gaps, edge cases, unsafe recommendations, and blind spots in medical reasoning.
• Provide detailed annotations and written feedback to refine AI models.
• Collaborate with researchers and project managers to align evaluation standards and project goals.

Skills

Clinical reasoning

Written communication

AI annotation experience (plus)

Education

Nurse Practitioner or Medical Doctor licensure

Job description

Turing invites Healthcare Experts to join projects that fine-tune AI models. If you enjoy applying clinical knowledge, analyzing complex medical scenarios, and providing clear, structured feedback, this is your chance to put your expertise to work in a new way.

Your healthcare experience will help shape how AI understands medical topics and patient care. The engagement is a contractor role with a total commitment of 40 hours spread over 4 weeks.