Remote AI Benchmark Engineer — PhD-Level Question Author

Obsidian; Detroit (MI); On-site; USD 90,000 - 130,000; Part time

Job summary

Obsidian is seeking expert engineers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core engineering domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, both remote and asynchronous, with a commitment of 10+ hours per week.

Qualifications

• PhD or doctoral candidate in Engineering or closely related field.
• Excellent written English and ability to express complex ideas clearly.
• Experience with academic assessment content is a plus.

Responsibilities

• Author original engineering questions that test deep conceptual understanding, not surface-level recall.
• Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement.
• Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
• Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format.
• Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories).
• For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Skills

Graduate-level engineering principles

Education

PhD

Master's degree (exceptional depth)

Job description

Obsidian is seeking expert engineers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core engineering domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: Question Authoring or Question Verification, both remote and asynchronous, with a commitment of 10+ hours per week.