Remote Physics Question Architect (AI Benchmarking)

Mercor; Greater London; Remote; GBP 83,000 - 138,000; Full time

Job summary

Mercor seeks expert physicists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous physics questions, evaluate solution quality, and help establish gold-standard benchmarks for advancing AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, with responsibilities spanning question design, difficulty rating, and documentation of changes.

Qualifications

• PhD or doctoral candidate in physics or closely related field.
• Excellent written English and ability to express complex ideas clearly.

Responsibilities

• Author original physics questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined -- all necessary information must be in the problem statement.
• Rate each question’s difficulty: Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions with clear intermediate steps in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify edits.

Skills

Graduate-level physics

Problem design

Education

PhD in Physics or related field

Master's degree considered for exceptional depth

Job description

Mercor seeks expert physicists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous physics questions, evaluate solution quality, and help establish gold-standard benchmarks for advancing AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, with responsibilities spanning question design, difficulty rating, and documentation of changes.