Philosopher for AI Benchmark Authoring and Review

SaidGig; New York (NY); Remote; USD 69,000 - 87,000; Part time

Job summary

SaidGig is seeking a research-driven philosophy content author to create and review rigorous academic assessment material for AI benchmarks. You will author or verify questions in Formal Ontology, AI Ethics, Epistemology, and Philosophy of Science, rating difficulty and documenting revisions.

Responsibilities include writing concise Markdown solutions, including references, and maintaining high standards of clarity and rigor.

Qualifications

• PhD or doctoral candidacy in Philosophy or a closely related field.
• Strong knowledge of philosophical argumentation and formal logic.
• Excellent written English and the ability to communicate complex ideas clearly.
• Research publications or philosophy teaching experience is a strong advantage.

Responsibilities

• Work in either question authoring or question verification.
• Develop original, challenging multiple-choice questions with difficulty ratings.
• Provide one correct answer and nine plausible distractors.
• Write clear, step-by-step solution explanations in Markdown.
• Include 1–5 academic references per question from reputable sources.

Skills

Philosophical argumentation

Formal logic

Canonical texts

Academic writing

Clear English communication

Education

PhD in Philosophy

Doctoral candidacy considered

Job description

Role Overview

Create and review rigorous academic assessment content that supports AI research benchmarks across Formal Ontology and Knowledge Representation, AI Ethics, Applied Epistemology, Philosophy of Technology and Robotics, and Philosophy of Science.

Key Responsibilities

• Work in either question authoring or question verification.
• For authoring assignments, develop original, challenging multiple-choice questions in your philosophy specialty, assign a difficulty rating, and submit work for review.
• For verification assignments, assess existing questions for accuracy, clarity, rigor, completeness, precision, and solvability; revise them when needed and document the rationale for each change.
• Design questions that evaluate deep conceptual understanding rather than surface-level recall, with all necessary information clearly defined within the prompt.
• Rate questions as Medium, introductory undergraduate; Hard, advanced undergraduate; or Expert, postgraduate and above.
• Provide one correct answer and nine plausible, subtly incorrect alternatives.
• Write clear, concise step-by-step solution explanations in Markdown.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals or university repositories.

Qualifications

• PhD or doctoral candidacy in Philosophy or a closely related field.
• A master''s degree may be considered for candidates with exceptional depth in a specific philosophy subdomain.
• Strong knowledge of philosophical argumentation, formal logic, and canonical texts across traditions.
• Research publications or philosophy teaching experience is a strong advantage.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

Work Terms

Fully remote, asynchronous hourly work.

Expected commitment of at least 10 hours per week.

Compensation$50 to $63 per hour.