AI Assessment Specialist - PhD

mercor; Deutschland; Remote; EUR 81,000 - 103,000; Full time

Job summary

Mercor is seeking an Applied Computer Science Benchmark Specialist for a remote, contract position. The role centers on authoring advanced CS questions, evaluating difficulty, and providing explanations with references.

Collaboration and precision are essential for high-quality benchmarks. The successful candidate will have a PhD or be a doctoral candidate in CS or related fields, with strong knowledge of theory, algorithms, ML, and systems design, plus excellent written English.

Qualifications

• PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field.
• Master's degree considered for candidates with exceptional depth in a specific subdomain.
• Strong command of graduate-level CS theory, algorithms, systems design, and/or machine learning.
• Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

• Author original computer science questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined.
• Rate each question's difficulty as Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability.

Skills

CS theory

Algorithms

Systems design

Machine learning

Written English

Education

PhD in Computer Science / Electrical Engineering

Doctoral candidate

Master's degree considered

Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Applied Computer Science Benchmark Specialist

Type: Contract

Compensation: $66–$84/hour

Location: Remote

Commitment: 10+ hours/week

Role Responsibilities

• Author original computer science questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined.
• Rate each question's difficulty as Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability.

Qualifications Must-Have

• PhD or doctoral candidate in Computer Science , Electrical Engineering , or a closely related field.
• Master's degree considered for candidates with exceptional depth in a specific subdomain.
• Strong command of graduate-level CS theory , algorithms , systems design , and/or machine learning .
• Excellent written English and ability to express complex ideas clearly and concisely.

Preferred

• Research publications, industry experience at top tech companies, or competitive programming background.

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to:

Originally posted on Himalayas