Medical Assessment Content Specialist - AI Trainer

Mercor

Nashville (TN)

On-site

USD 83,000 - 152,000

Part time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Mercor seeks expert medical and health science professionals to author and review high-quality academic assessment content for an AI research initiative. You will author or verify rigorous MCQs across core health and medicine domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

This is a fully remote, asynchronous engagement with an expected commitment of 10+ hours per week.

Qualifications

  • MD/DO/PhD or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or closely related field.
  • Strong command of graduate-level medical knowledge, clinical reasoning and biomedical research methodology.
  • Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

  • Author original health and medicine questions that test deep conceptual understanding, not surface-level recall.
  • Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement.
  • Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
  • Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
  • Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, clinical guidelines).
  • For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Skills

Clinical reasoning
Medical knowledge
Biomedical research

Education

MD/DO/PhD

Job description

Role Overview

We are seeking expert medical and health science professionals to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core health and medicine domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types:

  • Question Authoring

    — Create original, challenging multiple-choice questions in your area of medical expertise, rate their difficulty, and submit them for review.

  • Question Verification

    — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made.

Health & Medicine Domains Covered

Clinical Medicine & Surgery, Medical Imaging & Diagnostics, Pharmacovigilance, Healthcare Management & Economics, Rehabilitation and Allied Health.

Key Responsibilities
  • Author original health and medicine questions that test deep conceptual understanding, not surface-level recall

  • Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement

  • Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above)

  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers

  • Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format

  • Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, clinical guidelines)

  • For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made

Ideal Qualifications
  • MD, DO, PhD, or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or a closely related field

  • Master's degree considered for candidates with exceptional depth in a specific subdomain

  • Strong command of graduate-level medical knowledge, clinical reasoning, and biomedical research methodology

  • Board certification, clinical experience, or research publications in health fields is a strong plus

  • Excellent written English and ability to express complex ideas clearly and concisely

More About the Opportunity
  • Expected commitment: 10+ hours/week

  • Asynchronous, fully remote work

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Medical AI Assessment Architect — Remote Content & Review
Medical AI Assessment Architect — Remote Content & Review

Obsidian • Nashville (TN)

On-site
USD 26,000 - 52,000
AI Assessment Specialist - PhD - AI Trainer
AI Assessment Specialist - PhD - AI Trainer

Mercor • Philadelphia

On-site
USD 50,000 - 70,000
Remote Medical Assessment Content Architect
Remote Medical Assessment Content Architect

Obsidian • New York (NY)

On-site
USD 70,000 - 110,000
Fully remote
Flexible schedule
AI Assessment Specialist - PhD
AI Assessment Specialist - PhD

Mercor • New York (NY)

On-site
USD 55,000 - 124,000
Fully remote
Remote AI Medical Assessment Content Specialist
Remote AI Medical Assessment Content Specialist

Mercor • Nashville (TN)

On-site
USD 83,000 - 152,000
Biology PhD - Assessment Specialist - AI Trainer
Biology PhD - Assessment Specialist - AI Trainer

Mercor • San Jose (CA)

On-site
USD 41,000 - 83,000
Medical Assessment Content Specialist
Medical Assessment Content Specialist

Mercor • San Francisco (CA)

Hybrid
AUD 181,000 - 229,000
Medical Evaluation Specialist - Remote
Medical Evaluation Specialist - Remote

YO AI Labs • United States

Remote
USD 60,000 - 100,000
Psychology PhD - Assessment Specialist - AI Trainer
Psychology PhD - Assessment Specialist - AI Trainer

Mercor • New York (NY)

On-site
USD 90,000 - 120,000
Fully remote
Medical AI Quality Assurance Lead
Medical AI Quality Assurance Lead

OpenTrain AI • Northern (KY)

Hybrid
USD 112,000 - 150,000