Remote Medical Evaluation Specialist for AI Question-Writing

YO AI Labs; Houston (TX); Remote; USD 60,000 - 90,000; Full time

Job summary

YO AI Labs seeks Medical Evaluation Specialists to create and validate high-difficulty medical question-and-answer pairs for AI systems. You will synthesize complex clinical reasoning, verify answers with primary literature and guidelines, and document rationales with citations.

This remote contractor role emphasizes accuracy, clarity, and defensible medical content. No prior AI experience is required; strong medical knowledge, research skills, and clinical reasoning are essential to quality

Qualifications

• Medical training and licensure status or trainee level.
• Strong written English and attention to detail.
• Ability to locate, interpret, and synthesize primary literature and clinical guidelines.
• Capability to develop challenging, clinically nuanced questions.
• Ability to work independently in a remote, deadline-driven environment.

Responsibilities

• Create original, high-difficulty medical Q&A pairs covering diagnosis, pathophysiology, pharmacology, guidelines, and decision-making.
• Develop questions that require synthesis and medical reasoning beyond recall.
• Research and verify answers using primary literature, clinical guidelines, systematic reviews, and references.
• Document rationale with citations and support where appropriate.
• Evaluate AI-generated responses for clinical accuracy, completeness, and reasoning quality.
• Identify overly simple questions and refine for greater complexity while maintaining validity.
• Review questions for ambiguity, unsupported assumptions, and errors.
• Incorporate reviewer feedback and adapt to evolving project guidelines and quality standards.
• Contribute insights to establish rigorous benchmarks for medical AI evaluation.

Skills

Medical Training

Research & Source Triangulation

Attention to Detail

Written Precision

Analytical Thinking

Clinical Reasoning

Medical Literature Review

Evidence Synthesis

Self-Direction & Reliability

Medical Question Development

Education

Medical student, resident, or physician

Job description

YO AI Labs seeks Medical Evaluation Specialists to create and validate high-difficulty medical question-and-answer pairs for AI systems. You will synthesize complex clinical reasoning, verify answers with primary literature and guidelines, and document rationales with citations.

This remote contractor role emphasizes accuracy, clarity, and defensible medical content. No prior AI experience is required; strong medical knowledge, research skills, and clinical reasoning are essential to quality