Remote Applied CS Benchmark Specialist

mercor; United Kingdom; Remote; GBP 69,000 - 87,000; Part time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs, headquartered in San Francisco. They seek an Applied Computer Science Benchmark Specialist for a remote contract, paying $66–$84/hour, with 10+ hours per week commitment.

The role focuses on authoring CS questions, rating difficulty, and providing step-by-step solutions with references, while reviewing pre-written items and working asynchronously to meet deadlines.

Qualifications

• PhD or doctoral candidate in CS, EE, or closely related field.
• Strong command of graduate-level CS theory, algorithms, systems design, and/or ML.
• Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

• Author original computer science questions to test deep conceptual understanding.
• Rate each question's difficulty as Medium, Hard, or Expert and provide 1 correct answer with 9 plausible alternatives.
• Write step-by-step Chain-of-Thought solutions in markdown format with 1–5 academic references per question.
• Review pre-written questions for accuracy and clarity, flag issues and justify edits.
• Work independently and asynchronously to meet deadlines while advancing AI capabilities.

Skills

Graduate CS theory

Algorithms

Systems design

Machine learning

Excellent written English

Education

PhD or doctoral candidate in CS, EE, or related field

Job description

Mercor connects elite creative and technical talent with leading AI research labs, headquartered in San Francisco. They seek an Applied Computer Science Benchmark Specialist for a remote contract, paying $66–$84/hour, with 10+ hours per week commitment.

The role focuses on authoring CS questions, rating difficulty, and providing step-by-step solutions with references, while reviewing pre-written items and working asynchronously to meet deadlines.