Remote Applied Philosophy Benchmark Specialist

Mercor; San Francisco (CA); Hybrid; GBP 52,000 - 66,000; Full time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. The position is for an Applied Philosophy Benchmark Specialist on a remote contract with flexible hours and a 10+ hours/week commitment.

Responsibilities include authoring deep philosophy questions, ensuring clarity and self-containment, rating difficulty, and providing solutions with references. The role emphasizes rigor, cross-disciplinary reasoning, and high-quality standards for AI benchmarks.

Qualifications

• PhD or doctoral candidate in Philosophy or related field.
• Strong command of philosophical argumentation and logic.
• Publications or teaching experience in philosophy is a strong plus.
• Excellent written English.

Responsibilities

• Author original philosophy questions that test deep conceptual understanding, not surface-level recall.
• Ensure questions are unambiguous, self-contained, and precisely defined. Include all necessary information in the problem statement.
• Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
• Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Skills

Philosophical argumentation

Formal logic

Academic writing

Clear communication

Education

PhD or doctoral candidate

Master's degree considered

Job description

Mercor connects elite creative and technical talent with leading AI research labs. The position is for an Applied Philosophy Benchmark Specialist on a remote contract with flexible hours and a 10+ hours/week commitment.

Responsibilities include authoring deep philosophy questions, ensuring clarity and self-containment, rating difficulty, and providing solutions with references. The role emphasizes rigor, cross-disciplinary reasoning, and high-quality standards for AI benchmarks.