Applied CS Benchmark Specialist - Remote Contract

Visa Hunt; United States; Remote; USD 91,000 - 116,000; Part time

Job summary

Mercor is seeking a contracted Applied Computer Science Benchmark Specialist to develop and evaluate advanced CS questions for AI research labs. Remote engagement requires ~10+ hours per week, with compensation available as an hourly rate.

The role emphasizes creating unambiguous questions, rating difficulty levels, and providing step-by-step explanations with references, while reviewing existing content for clarity and accuracy.

Qualifications

• PhD in CS or closely related field.
• Strong command of graduate-level CS theory, algorithms, systems design, and/or machine learning.
• Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

• Author original computer science questions to test deep conceptual understanding.
• Rate each question's difficulty as Medium, Hard, or Expert with correct and plausible distractors.
• Write step-by-step Chain-of-Thought solutions with up to 5 references per question.
• Review pre-written questions for accuracy and clarity and justify edits.
• Work independently and asynchronously to meet deadlines.

Skills

PhD in CS/EE

Graduate CS theory

Algorithms

Systems design

Machine learning

Excellent English

Education

PhD or doctoral candidate

Master's degree considered

Job description

Mercor is seeking a contracted Applied Computer Science Benchmark Specialist to develop and evaluate advanced CS questions for AI research labs. Remote engagement requires ~10+ hours per week, with compensation available as an hourly rate.

The role emphasizes creating unambiguous questions, rating difficulty levels, and providing step-by-step explanations with references, while reviewing existing content for clarity and accuracy.