Remote Medical Q&A Designer for AI Evaluation

YO AI Labs; Illinois; Remote; USD 83,000 - 152,000; Part time

Job summary

YO AI Labs is seeking Medical Evaluation Specialists (medical students, residents, physicians, or biomedical professionals) to contribute clinical expertise for evaluating AI systems. You will craft challenging medical QA pairs and validate them with supporting citations, focusing on synthesis, interpretation, and nuanced clinical judgment.

No AI-specific experience is required; strong medical knowledge, research skills, and clinical reasoning are essential for this remote contractor role.

Qualifications

• Medical training, research and source triangulation are essential.
• High attention to detail and written precision are required.
• Strong analytical thinking and clinical reasoning are expected.
• Experience with medical literature review and evidence synthesis is preferred.
• Ability to develop rigorous medical questions and maintain reliability.

Responsibilities

• Create original, high-difficulty medical question-and-answer pairs.
• Research answers using primary literature and clinical guidelines.
• Document rationale with supporting citations.
• Evaluate AI-generated responses for accuracy and evidence adherence.
• Refine questions to increase complexity while maintaining validity.
• Review for ambiguity, errors, and inconsistencies; ensure clarity.

Skills

Medical Training

Research & Source Triangulation

Attention to Detail

Written Precision

Analytical Thinking

Clinical Reasoning

Evidence Synthesis

Medical Question Development

Education

Medical training (student, resident, or physician)

Job description

YO AI Labs is seeking Medical Evaluation Specialists (medical students, residents, physicians, or biomedical professionals) to contribute clinical expertise for evaluating AI systems. You will craft challenging medical QA pairs and validate them with supporting citations, focusing on synthesis, interpretation, and nuanced clinical judgment.

No AI-specific experience is required; strong medical knowledge, research skills, and clinical reasoning are essential for this remote contractor role.