Remote Philosophy Assessment & AI Training Specialist

Obsidian

Boston (MA)

On-site

USD 12,000 - 18,000

Part time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Obsidian is seeking expert philosophers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You may focus on Question Authoring or Question Verification, rate each item’s difficulty, provide 1 correct answer with 9 plausible distractors, and document edits with

Qualifications

  • Philosophy-focused qualifications including advanced argumentation and logic.
  • PhD or doctoral candidate status is preferred; strong written English required.
  • Experimental evaluation of questions and ability to provide rigorous reasoning.

Responsibilities

  • Author original philosophy questions that test deep conceptual understanding.
  • Rate each question's difficulty: Medium, Hard, or Expert.
  • Provide 1 correct answer and 9 plausible distractors.
  • Write step-by-step Chain-of-Thought solutions in markdown format.
  • Supply 1–5 academic references per question from reputable sources.
  • For verification tasks: flag clarity, completeness, precision, solvability and justify edits.

Skills

Philosophical argumentation
Formal logic
Clear writing
Academic references

Education

PhD
Master's degree in philosophy

Job description

Obsidian is seeking expert philosophers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You may focus on Question Authoring or Question Verification, rate each item’s difficulty, provide 1 correct answer with 9 plausible distractors, and document edits with

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote Philosophy Expert — AI Assessment & Content Creator
Remote Philosophy Expert — AI Assessment & Content Creator

Obsidian • New York (NY)

Remote
USD 55,000 - 124,000
Philosophy PhD - Assessment Specialist - AI Trainer
Philosophy PhD - Assessment Specialist - AI Trainer

Mercor • Boston (MA)

On-site
USD 65,000 - 95,000
Remote Philosophy PhD & Assessment Content Specialist
Remote Philosophy PhD & Assessment Content Specialist

Mercor • New York (NY)

On-site
USD 55,000 - 83,000
Fully remote work
Flexible schedule
Philosophy PhD - Assessment Specialist
Philosophy PhD - Assessment Specialist

Mercor • New York (NY)

On-site
USD 55,000 - 83,000
Fully remote work
Flexible schedule
Remote Psychology PhD Assessment Specialist - AI Content & QA
Remote Psychology PhD Assessment Specialist - AI Content & QA

Obsidian • New York (NY)

On-site
USD 83,000 - 131,000
Remote AI Psychology Assessment Architect
Remote AI Psychology Assessment Architect

Obsidian • New York (NY)

On-site
USD 55,000 - 110,000
Remote AI Assessment Architect (PhD) & Trainer
Remote AI Assessment Architect (PhD) & Trainer

Obsidian • Philadelphia

On-site
USD 69,000 - 96,000
Remote Psychometrics Expert for AI Assessment Content
Remote Psychometrics Expert for AI Assessment Content

Obsidian • New York (NY)

Remote
USD 69,000 - 124,000
Remote Law Content Author for AI Assessment & Benchmarks
Remote Law Content Author for AI Assessment & Benchmarks

Obsidian • New York (NY)

Remote
USD 60,000 - 90,000
Fully remote
Asynchronous work
10+ hours/week
Remote AI Benchmark Engineer — PhD-Level Question Author
Remote AI Benchmark Engineer — PhD-Level Question Author

Obsidian • Detroit (MI)

On-site
USD 90,000 - 130,000