Remote Health & Medicine Benchmark Specialist (Contract)

mercor; San Francisco (CA); Hybrid; AUD 186,000 - 235,000; Part time

Job summary

Mercor is seeking a contracted Applied Health & Medicine Benchmark Specialist to work remotely with our AI research focus. You will craft health and medicine benchmark questions, rate difficulty, and assemble correct answers with plausible distractors.

This role requires advanced medical training, strong English writing, and the ability to justify edits with clear reasoning. Commitment is 10+ hours per week; compensation is $94–$119 per hour.

Qualifications

• MD, DO, PhD, or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or related field.
• Master's degree considered for exceptional depth in a subdomain.
• Strong command of graduate-level medical knowledge, clinical reasoning, and biomedical research methodology.
• Board certification, clinical experience, or publications in health fields is a strong plus.
• Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

• Author original health and medicine questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information included.
• Rate each question's difficulty as Medium, Hard, or Expert to challenge expert-level solvers.
• Provide one correct answer and nine plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks, flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Skills

Graduate-level medical knowledge

Clinical reasoning

Biomedical research methodology

Written English proficiency

Education

MD/DO/PhD or doctoral candidate in Medicine or related field

Master's degree considered for exceptional depth

Job description

Mercor is seeking a contracted Applied Health & Medicine Benchmark Specialist to work remotely with our AI research focus. You will craft health and medicine benchmark questions, rate difficulty, and assemble correct answers with plausible distractors.

This role requires advanced medical training, strong English writing, and the ability to justify edits with clear reasoning. Commitment is 10+ hours per week; compensation is $94–$119 per hour.