Remote Philosophy Benchmark Specialist (Contract)

Mercor; Sydney; Remote; AUD 99,000 - 124,000; Part time

Job summary

Mercor is seeking an Applied Philosophy Benchmark Specialist for a remote contract role delivering 10+ hours/week. Compensation is $50–$63/hour, with flexible scheduling to accommodate research and evaluation tasks for AI labs.

The role focuses on creating rigorous philosophy benchmarks, drafting test questions, and supplying references. A PhD candidate or PhD holder is preferred, with strong written English and analytical skills.

Qualifications

• PhD or doctoral candidate in Philosophy or closely related field.
• Master's degree considered for exceptional depth.
• Strong command of philosophical argumentation, formal logic, and canonical texts.
• Publications or teaching experience in philosophy is a strong plus.
• Excellent written English and ability to express complex ideas clearly.

Responsibilities

• Author original philosophy questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined. Include all necessary information in the problem statement.
• Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
• Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
• Supply 1–5 academic references per question from reputable sources like peer-reviewed journals or university repositories.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Skills

Philosophical argumentation

Formal logic

Academic writing

Critical thinking

Education

PhD in Philosophy

PhD candidate in Philosophy

Master's degree in Philosophy

Job description

Mercor is seeking an Applied Philosophy Benchmark Specialist for a remote contract role delivering 10+ hours/week. Compensation is $50–$63/hour, with flexible scheduling to accommodate research and evaluation tasks for AI labs.

The role focuses on creating rigorous philosophy benchmarks, drafting test questions, and supplying references. A PhD candidate or PhD holder is preferred, with strong written English and analytical skills.