[Contract] Applied Health & Medicine Benchmark Specialist

1000scholars; United States; Remote; USD 27,000 - 36,000; Part time

Job summary

1000scholars seeks expert medical and health science professionals to author and review high-quality academic assessment content for an AI research initiative. Remote, asynchronous, 10+ hours/week, independent contractor role.

You will write and verify rigorous MCQs across health domains, evaluate solutions, and help establish gold standards for AI benchmarking.

Qualifications

• MD, DO, PhD or doctoral candidate in medicine or biomedical sciences.
• Strong command of graduate-level medical knowledge and research methods.
• Excellent written English and ability to express complex ideas clearly.

Responsibilities

• Author original health and medicine questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined.
• Rate each question's difficulty: Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• Flag issues with clarity or solvability and justify edits.

Skills

Medical knowledge

Clinical reasoning

Academic writing

English proficiency

Education

MD/DO/PhD or doctoral candidate

Master's degree considered

Tools

PubMed

EndNote / Reference manager

Job description

Role Overview

We are seeking expert medical and health science professionals to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core health and medicine domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types:

Health & Medicine Domains Covered

• Clinical Medicine & Surgery
• Medical Imaging & Diagnostics
• Pharmacovigilance
• Healthcare Management & Economics
• Rehabilitation and Allied Health

Key Responsibilities

• Author original health and medicine questions that test deep conceptual understanding, not surface-level recall
• Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement
• Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above)
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers
• Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format
• Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, clinical guidelines)
• For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made

Ideal Qualifications

• MD, DO, PhD, or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or a closely related field
• Master's degree considered for candidates with exceptional depth in a specific subdomain
• Strong command of graduate-level medical knowledge, clinical reasoning, and biomedical research methodology
• Board certification, clinical experience, or research publications in health fields is a strong plus
• Excellent written English and ability to express complex ideas clearly and concisely

More About the Opportunity

• Expected commitment: 10+ hours/week
• Asynchronous, fully remote work
• We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.