AI CS Benchmark Engineer (Remote)

1000scholars; United States; Remote; USD 90,000 - 140,000; Part time

Job summary

Mercor is seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will create and verify rigorous CS questions, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

Role includes writing original questions or verifying pre-written ones, rating difficulty, and providing references. Remote, asynchronous work with weekly payments and independent contractor terms.

Qualifications

• PhD or doctoral candidate in CS, EE, or a closely related field.
• Strong command of graduate-level CS theory, algorithms, systems design, and ML.
• Publications or industry/research background is a plus.

Responsibilities

• Author original CS questions that test deep conceptual understanding.
• Rate difficulty: Medium, Hard, or Expert according to the rubric.
• Provide 1 correct answer and 9 plausible distractors for each question.
• Write step-by-step Chain-of-Thought solutions with intermediate steps.
• Supply 1–5 academic references per question.

Skills

CS theory

Algorithms

Systems design

Machine learning

Education

PhD

Master's degree considered

Job description

Mercor is seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will create and verify rigorous CS questions, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

Role includes writing original questions or verifying pre-written ones, rating difficulty, and providing references. Remote, asynchronous work with weekly payments and independent contractor terms.