Remote Philosophy Benchmark Specialist

Mercor; United States; Remote; USD 69,000 - 87,000; Full time

Job summary

Mercor is seeking expert philosophers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, and you will work fully remotely with an expected commitment of 10+ hours per week.

Qualifications

• PhD or doctoral candidate in Philosophy or closely related field.
• Strong command of philosophical argumentation and canonical texts.

Responsibilities

• Author original philosophy questions testing deep conceptual understanding.
• Rate difficulty: Medium, Hard, or Expert for each item.
• Provide 1 correct answer and 9 plausible alternatives.
• Write step-by-step Chain-of-Thought solutions with reasoning (markdown).
• Supply 1–5 academic references per question.
• Verify and edit questions for clarity, completeness, precision, or solvability.

Skills

Academic writing

Formal logic

Critical thinking

Education

PhD in Philosophy

Job description

Mercor is seeking expert philosophers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, and you will work fully remotely with an expected commitment of 10+ hours per week.