Remote Applied CS Benchmark Specialist (Contract)

mercor; United States; Remote; USD 91,000 - 116,000; Full time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. The role of Applied Computer Science Benchmark Specialist is a remote contract position designed for deeply knowledgeable researchers.

You will author original CS questions, rate their difficulty, and provide correct answers with plausible distractors, while ensuring questions are unambiguous and well-defined. The role requires a PhD or doctoral candidate in CS/EE, strong command of graduate-level theory,

Qualifications

• PhD or doctoral candidate in CS, EE, or closely related field.
• Strong command of graduate-level CS theory, algorithms, systems design, and/or ML.
• Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

• Author original computer science questions to test deep conceptual understanding. Ensure questions are unambiguous, self-contained, and precisely defined.
• Rate each question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions in markdown format. Supply 1–5 academic references per question from reputable sources.
• For verification tasks, review pre-written questions for accuracy and clarity. Flag issues and justify any edits made.
• Work independently and asynchronously to meet deadlines while advancing AI capabilities.

Skills

Graduate-level CS theory

Algorithms

Systems design

Machine learning

Excellent written English

Education

PhD in CS or Electrical Engineering

PhD candidate in CS/EE

Job description

Mercor connects elite creative and technical talent with leading AI research labs. The role of Applied Computer Science Benchmark Specialist is a remote contract position designed for deeply knowledgeable researchers.

You will author original CS questions, rate their difficulty, and provide correct answers with plausible distractors, while ensuring questions are unambiguous and well-defined. The role requires a PhD or doctoral candidate in CS/EE, strong command of graduate-level theory,