Remote Medical AI Evaluation & Clinical Reasoning Specialist

YO AI Labs

Washington (District of Columbia)

Remote

USD 13,000 - 26,000

Part time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

YO AI Labs seeks Medical Evaluation Specialists (contractor) to contribute clinical expertise to an AI evaluation project. You will craft and validate high-difficulty medical questions and answers, test AI interpretations, and provide defensible rationales with citations.

Applicants should have medical training and strong literature review skills. Remote work is supported; start within 24–48 hours of onboarding, with compensation per task based on quality and project specs.

Qualifications

  • Medical training and clinical expertise for creating and evaluating medical questions
  • Ability to locate, interpret, and synthesize information from primary literature and guidelines
  • Excellent written English with strong attention to detail and clarity
  • Experience in developing engaging, clinically nuanced questions for AI evaluation

Responsibilities

  • Create original, high-difficulty medical Q&A pairs covering diagnosis, pathophysiology, pharmacology, guidelines, and decision-making
  • Develop questions requiring synthesis, interpretation, and clinical reasoning beyond simple recall
  • Research and verify answers using primary literature, clinical guidelines, and reviews with citations
  • Document rationale and provide appropriate supporting citations for each answer
  • Evaluate AI-generated responses for accuracy, completeness, and alignment with evidence
  • Refine questions to increase complexity while maintaining clinical validity

Skills

Medical Training
Research Triangulation
Attention to Detail
Written Precision
Analytical Thinking
Clinical Reasoning
Medical Literature Review
Evidence Synthesis
Self-Direction
Medical Question Development

Job description

YO AI Labs seeks Medical Evaluation Specialists (contractor) to contribute clinical expertise to an AI evaluation project. You will craft and validate high-difficulty medical questions and answers, test AI interpretations, and provide defensible rationales with citations.

Applicants should have medical training and strong literature review skills. Remote work is supported; start within 24–48 hours of onboarding, with compensation per task based on quality and project specs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Medical Evaluation Architect for AI Testing
Remote Medical Evaluation Architect for AI Testing

YO AI Labs • Palo Alto (CA)

Remote
USD 83,000 - 165,000
Medical AI Evaluation Specialist (Remote)
Medical AI Evaluation Specialist (Remote)

YO AI Labs • United States

Remote
USD 60,000 - 100,000
Remote Medical Evaluation Specialist (Contract)
Remote Medical Evaluation Specialist (Contract)

YO AI Labs • New York (NY)

Remote
USD 45,000 - 89,000
Remote Medical AI Evaluation Specialist
Remote Medical AI Evaluation Specialist

YO AI Labs • Los Angeles (CA)

Remote
USD 60,000 - 90,000
Remote Medical AI Evaluation Specialist
Remote Medical AI Evaluation Specialist

YO AI Labs • Seattle (WA)

Remote
USD 55,000 - 96,000
Remote Medical Evaluation Specialist for AI Benchmarking
Remote Medical Evaluation Specialist for AI Benchmarking

YO AI Labs • San Jose (CA)

Remote
USD 83,000 - 138,000
Remote Medical Q&A Designer for AI Evaluation
Remote Medical Q&A Designer for AI Evaluation

YO AI Labs • Miami (FL)

Remote
USD 50,000 - 80,000
Remote Medical Evaluation Specialist for AI Benchmarks
Remote Medical Evaluation Specialist for AI Benchmarks

YO AI Labs • Town of Schroeppel (NY)

Remote
USD 83,000 - 124,000
Remote work
Flexible schedule
Remote Medical AI Evaluation Architect
Remote Medical AI Evaluation Architect

YO AI Labs • Philadelphia

Remote
USD 60,000 - 110,000
Remote Medical Evaluation Architect for AI Benchmarks
Remote Medical Evaluation Architect for AI Benchmarks

YO AI Labs • Dallas (TX)

Remote
USD 83,000 - 152,000