Clinical AI Medical Evaluator: Complex Question Writer

YO AI Labs; Atlanta (GA); Remote; USD 55,000 - 110,000; Part time

Job summary

YO AI Labs seeks Medical Evaluation Specialists to craft and validate challenging medical questions for evaluating AI systems. This remote contractor role welcomes medical students, residents, physicians, and biomedical professionals.

You will build complex Q&A pairs, justify answers with citations, and assess AI outputs for clinical accuracy and reasoning. Medical knowledge and research skills are essential.

Qualifications

• Medical training and clinical education are required.
• Strong written English with precise, well-structured communication.
• Ability to locate, interpret, and synthesize medical literature.

Responsibilities

• Create high-difficulty medical Q&A pairs covering diagnosis, pathophysiology, pharmacology and guidelines.
• Develop questions that require synthesis and clinical reasoning beyond recall.
• Research and verify answers using primary literature and guidelines.
• Document rationales with supporting citations.
• Evaluate AI-generated responses for accuracy and reasoning.

Skills

Medical Training

Research & Source Triangulation

Attention to Detail

Written Precision

Analytical Thinking

Clinical Reasoning

Medical Literature Review

Evidence Synthesis

Self-Direction & Reliability

Medical Question Development

Education

Medical training or equivalent clinical education

Job description

YO AI Labs seeks Medical Evaluation Specialists to craft and validate challenging medical questions for evaluating AI systems. This remote contractor role welcomes medical students, residents, physicians, and biomedical professionals.

You will build complex Q&A pairs, justify answers with citations, and assess AI outputs for clinical accuracy and reasoning. Medical knowledge and research skills are essential.