AI Benchmark CS Question Author (Remote Contractor)

Weekday 1; United States; Remote; USD 91,000 - 116,000; Part time

Benefits offered by this job

Fully remote

Job summary

Weekday 1 is seeking experienced computer science professionals to author and review high-quality academic assessment content for an AI research initiative. You will develop and validate rigorous multiple-choice questions across CS domains, assess solution quality, and help establish gold-standard benchmarks for evaluating advanced AI systems.

You will contribute through two primary task types: Question Authoring and Question Verification, ensuring accuracy, clarity, and rigor.

Qualifications

• PhD or doctoral candidacy in CS, EE, or related field.
• Strong command of graduate-level CS theory, algorithms, systems, software engineering, or ML.
• Demonstrated depth in at least one listed CS domain.
• Excellent written English and ability to communicate complex concepts clearly.

Responsibilities

• Create original CS questions evaluating deep conceptual understanding and problem-solving.
• Ensure questions are unambiguous, self-contained, and technically accurate.
• Classify questions by difficulty: Medium, Hard, Expert.
• Provide one correct answer with nine plausible distractors.
• Develop clear solution explanations showing reasoning and principles.
• Provide 1–5 references per question from reputable sources.
• Identify and explain edits for verification tasks.
• Apply consistent standards for benchmark quality and reproducibility.

Skills

Academic writing

Technical writing

Question authoring

Question verification

Education

PhD in Computer Science

Master’s in Computer Science

Job description

Weekday 1 is seeking experienced computer science professionals to author and review high-quality academic assessment content for an AI research initiative. You will develop and validate rigorous multiple-choice questions across CS domains, assess solution quality, and help establish gold-standard benchmarks for evaluating advanced AI systems.

You will contribute through two primary task types: Question Authoring and Question Verification, ensuring accuracy, clarity, and rigor.