Remote AI Assessment Architect (PhD) & Trainer

Obsidian; Philadelphia (Philadelphia County); On-site; USD 69,000 - 96,000; Part time

Job summary

Obsidian seeks expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will craft rigorous multiple-choice questions across core CS domains, rate difficulty, and contribute to gold-standard benchmarks used to advance AI capabilities.

You will work asynchronously and remotely, with a focus on 10+ hours per week, collaborating on a broad range of CS topics from hardware to ML, and ensuring questions are precise, self-contained,

Qualifications

• PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field.
• Master's degree considered for candidates with exceptional depth in a specific subdomain.
• Strong command of graduate-level CS theory, algorithms, systems design, and/or machine learning.
• Research publications, industry experience at top tech companies, or competitive programming background is a strong plus.
• Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

• Author original computer science questions that test deep conceptual understanding, not surface-level recall.
• Ensure questions are unambiguous, self-contained, and precisely defined - all necessary information must be in the problem statement.
• Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers
• Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format
• Supply 1-5 academic references per question from reputable sources (peer-reviewed journals, university repositories)
• For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made

Skills

Question authoring

Question verification

CS theory

Algorithms

Distributed systems

Education

PhD or doctoral candidate in CS/EE

Master's degree considered

Job description

Obsidian seeks expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will craft rigorous multiple-choice questions across core CS domains, rate difficulty, and contribute to gold-standard benchmarks used to advance AI capabilities.

You will work asynchronously and remotely, with a focus on 10+ hours per week, collaborating on a broad range of CS topics from hardware to ML, and ensuring questions are precise, self-contained,