Remote CS Benchmark Expert for AI Research

Obsidian; Greater London; Remote; GBP 41,000 - 83,000; Part time

Benefits offered by this job

Fully remote work

Job summary

Obsidian is seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core CS domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, with responsibilities including rating difficulty, editing for clarity, and

Qualifications

• PhD or doctoral candidate in Computer Science or closely related field.
• Excellent written English with ability to convey complex ideas clearly.
• Strong command of graduate-level CS theory, algorithms, and systems concepts.

Responsibilities

• Author original CS questions that test deep conceptual understanding.
• Review and verify questions for accuracy, clarity, and rigor.
• Rate each question’s difficulty: Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible distractors.
• Write step-by-step Chain-of-Thought solutions in markdown format.
• Provide 1–5 academic references per question.

Skills

PhD-level writing

Graduate CS theory

Academic English writing

Attention to detail

Rigorous editing

Education

PhD in Computer Science

Master’s degree in CS

Job description

Obsidian is seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core CS domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, with responsibilities including rating difficulty, editing for clarity, and