Remote CS Benchmark Architect for AI Evaluation

Weekday AI

United States

Remote

USD 91,000 - 116,000

Part time

14 days+

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Weekday AI is seeking experienced computer science professionals to author and review high-quality academic assessment content for an AI research initiative. You will develop and validate rigorous multiple-choice questions across CS domains, assess solution quality, and help establish gold-standard benchmarks for evaluating advanced AI systems.

You will contribute as a Question Authoring or Question Verification role, developing original questions or reviewing existing ones for accuracy,

Qualifications

PhD or doctoral candidacy in Computer Science, Electrical Engineering, Computer Engineering, or closely related discipline.
Strong command of graduate-level CS theory, algorithms, systems, software engineering, architecture, and/or machine learning.
Demonstrated depth in one or more of the listed technical domains.

Responsibilities

Create original CS questions that evaluate deep conceptual understanding and problem solving.
Verify existing questions for technical accuracy, clarity, completeness, and rigor; edit as needed and document reasoning.
Provide clear, structured solution explanations and references for each question.
Identify issues in verification assignments and explain recommended edits clearly.
Apply consistent standards to ensure benchmark quality and reproducibility.