Medical Assessment Content Specialist

Mercor; San Francisco (CA); Hybrid; AUD 181,000 - 229,000; Full time

Job summary

Mercor is seeking an Applied Health & Medicine Benchmark Specialist for a remote, contract role. You will craft health and medicine benchmark questions to test advanced understanding and domain knowledge.

Responsibilities include ensuring questions are unambiguous, self-contained, and precisely defined, with balanced difficulty ratings. You will also provide correct answers, plausible distractors, and references.

Qualifications

• MD/DO/PhD or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or related field.
• Strong graduate-level medical knowledge and clinical reasoning.
• Experience with biomedical research methodology is preferred.

Responsibilities

• Develop health and medicine benchmark questions with clear, self-contained prompts.
• Ensure questions are unambiguous, precisely defined, and fully resourced.
• Rate question difficulty as Medium, Hard, or Expert for validation sets.
• Provide one correct answer and nine plausible distractors.
• Compose concise step-by-step explanations and cite references.
• Flag issues with clarity or solvability and justify edits.

Skills

Medical knowledge

Clinical reasoning

Research methodology

Education

MD/DO/PhD or doctoral candidate

Master's degree considered

Job description

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Applied Health & Medicine Benchmark Specialist

Type: Contract

Compensation: $94–$119/hour

Location: Remote

Commitment: 10+ hours/week

Role Responsibilities

• Author original health and medicine questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information included.
• Rate each question's difficulty as Medium, Hard, or Expert to challenge expert-level solvers.
• Provide one correct answer and nine plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks, flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Qualifications

Must-Have

• MD, DO, PhD, or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or a closely related field.
• Master's degree considered for candidates with exceptional depth in a specific subdomain.
• Strong command of graduate-level medical knowledge, clinical reasoning, and biomedical research methodology.
• Board certification, clinical experience, or research publications in health fields is a strong plus.
• Excellent written English and ability to express complex ideas clearly and concisely.

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: [e-mail]