Remote Chemistry Benchmark Architect

1000scholars; United States; Remote; USD 60,000 - 100,000; Part time

Job summary

Mercor is seeking expert chemists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core chemistry domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring and Question Verification, with responsibilities to create or edit questions, rate difficulty, and provide

Qualifications

• PhD or doctoral candidate in Chemistry, Biochemistry, Chemical Engineering, or a closely related field.
• Master's degree considered for candidates with exceptional depth in a specific subdomain.
• Strong command of graduate-level chemistry concepts, reaction mechanisms, and quantitative analysis.
• Experience with rigorous academic problem design or chemistry olympiad writing is a strong plus.
• Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

• Author original chemistry questions that test deep conceptual understanding, not surface-level recall.
• Ensure questions are unambiguous, self-contained, and precisely defined - all necessary information must be in the problem statement.
• Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
• Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format.
• Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories).
• For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Skills

Chemistry expertise

Graduate-level concepts

Academic problem design

English writing

Education

PhD or doctoral candidate in Chemistry/Biochemistry/Chemical Engineering

Master's degree considered for specialization

Job description

Mercor is seeking expert chemists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core chemistry domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring and Question Verification, with responsibilities to create or edit questions, rate difficulty, and provide