Remote AI Assessment Architect, PhD

Mercor; San Francisco (CA); Hybrid; GBP 68,000 - 87,000; Full time

Job summary

Mercor is seeking an Applied Computer Science Benchmark Specialist for a remote, contract engagement. The role requires 10+ hours per week and pays $66–$84 per hour. You will create and evaluate CS questions, rate difficulty, provide solutions and references, and flag any issues in verification tasks.

A PhD or doctoral candidate in CS/EE is required. Strong CS theory, algorithms, systems design, and ML knowledge are essential, along with excellent written English.

Qualifications

• PhD or doctoral candidate in Computer Science, Electrical Engineering, or closely related field.
• Master's degree considered for exceptional depth in a subdomain.
• Strong command of graduate-level CS theory, algorithms, systems design, and/or machine learning.
• Excellent written English and ability to express complex ideas clearly and concisely.

Responsibilities

• Author original CS questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined.
• Rate each question's difficulty as Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability.

Skills

CS theory

Algorithms

Systems design

Machine learning

Written English

Education

PhD in CS/EE or related field

Master's degree considered for exceptional depth

Job description

Mercor is seeking an Applied Computer Science Benchmark Specialist for a remote, contract engagement. The role requires 10+ hours per week and pays $66–$84 per hour. You will create and evaluate CS questions, rate difficulty, provide solutions and references, and flag any issues in verification tasks.

A PhD or doctoral candidate in CS/EE is required. Strong CS theory, algorithms, systems design, and ML knowledge are essential, along with excellent written English.