CS Benchmark Expert - Fully Remote | Upto $84/hr

mercor; San Francisco (CA); Hybrid; GBP 69,000 - 87,000; Part time

Job summary

Mercor is seeking an Applied Computer Science Benchmark Specialist on a remote, contract basis. The role requires developing deep CS questions, validating clarity and precision, and rating difficulty levels for each item.

The work is flexible, with a commitment of 10+ hours per week. Ideal candidates hold a PhD or are doctoral candidates in CS/EE, with strong knowledge of CS theory, algorithms, systems design, and ML, plus excellent written English.

Qualifications

• PhD or doctoral candidate in Computer Science, Electrical Engineering, or closely related field.
• Master's degree considered for exceptional depth in a subdomain.
• Strong command of graduate-level CS theory, algorithms, systems design, and/or ML.
• Excellent written English with clear and concise expression.

Responsibilities

• Author original computer science questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined.
• Rate each question's difficulty as Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability.

Skills

Graduate-level CS theory

Algorithms

Systems design

Machine learning

Written English

Education

PhD or doctoral candidate in CS/EE

Master's degree considered

Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Applied Computer Science Benchmark Specialist

Type: Contract

Compensation: $66–$84/hour

Location: Remote

Commitment: 10+ hours/week

Role Responsibilities

• Author original computer science questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined.
• Rate each question's difficulty as Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability.

Qualifications Must-Have

• PhD or doctoral candidate in Computer Science , Electrical Engineering , or a closely related field.
• Master's degree considered for candidates with exceptional depth in a specific subdomain.
• Strong command of graduate-level CS theory , algorithms , systems design , and/or machine learning .
• Excellent written English and ability to express complex ideas clearly and concisely.

Preferred

• Research publications, industry experience at top tech companies, or competitive programming background.

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to:

Originally posted on Himalayas