Health & Medicine Benchmark Architect — Remote

Appsierra Group; American Samoa; On-site; USD 129,000 - 164,000; Full time

Job summary

Appsierra Group is seeking a remote Health & Medicine Benchmark Specialist to develop and review rigorous academic assessment content for an AI research initiative. You will author and verify questions in health and medicine, evaluate solution quality, and contribute to high-quality benchmarks used to advance AI capabilities.

Responsibilities include question authoring or verification, rating difficulty, and providing detailed reasoning and references.

Qualifications

• MD/DO/PhD or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or closely related field.
• Master's degree may be considered for exceptional expertise in a subdomain.
• Strong graduate-level knowledge of medicine and health sciences.
• Strong clinical reasoning and biomedical research methodology skills.
• Board certification, clinical experience, or health-related publications advantageous.
• Excellent written English with ability to communicate complex concepts clearly and concisely.

Responsibilities

• Create original, challenging questions that assess deep conceptual understanding.
• Ensure each question is unambiguous, self-contained, precisely defined, and includes all information necessary to solve it.
• Rate question difficulty: Medium = Undergraduate, Hard = Advanced Undergraduate, Expert = Postgraduate level.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Develop clear, concise step-by-step reasoning in markdown format.
• Provide 1–5 reputable academic references per question.

Skills

Clinical reasoning

Biomedical research methods

Academic writing

Education

MD/DO/PhD or doctoral candidate in Medicine/Biomedical Sciences/Public Health

Master's degree considered for exceptional candidates

Job description

Appsierra Group is seeking a remote Health & Medicine Benchmark Specialist to develop and review rigorous academic assessment content for an AI research initiative. You will author and verify questions in health and medicine, evaluate solution quality, and contribute to high-quality benchmarks used to advance AI capabilities.

Responsibilities include question authoring or verification, rating difficulty, and providing detailed reasoning and references.