AI Benchmark Engineer — PhD (Remote & Flexible)

Mercor

New York (NY)

On-site

USD 55,000 - 110,000

Part time

9 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Mercor is seeking expert engineers to author and review high-quality academic assessment content for an AI research initiative. You will craft and verify rigorous MCQs across core engineering domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will work asynchronously from anywhere, committing roughly 10+ hours per week. The role emphasizes deep conceptual problem design, precise wording, and clear explanations suitable for

Qualifications

  • PhD or doctoral candidate in Engineering required or highly preferred.
  • Excellent written English and concise technical communication.
  • Strong command of graduate-level engineering principles and applied mathematics.

Responsibilities

  • Author original engineering questions that test deep conceptual understanding.
  • Rate difficulty and provide 1 correct answer plus 9 plausible distractors.
  • Review and edit pre-written questions for accuracy and rigor.
  • Provide step-by-step Chain-of-Thought solutions in markdown format.
  • Supply 1–5 academic references per question.
  • Flag clarity and solvability issues when verifying questions.

Skills

Graduate-level engineering principles
Technical writing
English proficiency

Education

PhD or doctoral candidate in Engineering
Master's degree in engineering

Job description

Mercor is seeking expert engineers to author and review high-quality academic assessment content for an AI research initiative. You will craft and verify rigorous MCQs across core engineering domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will work asynchronously from anywhere, committing roughly 10+ hours per week. The role emphasizes deep conceptual problem design, precise wording, and clear explanations suitable for

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote Engineering PhD Assessment Specialist
Remote Engineering PhD Assessment Specialist

Mercor • New York (NY)

On-site
USD 48,000 - 96,000
Remote AI Benchmark Engineer — PhD-Level Question Author
Remote AI Benchmark Engineer — PhD-Level Question Author

Obsidian • Detroit (MI)

On-site
USD 90,000 - 130,000
Remote AI Benchmark Engineer (PhD)
Remote AI Benchmark Engineer (PhD)

Obsidian • New York (NY)

On-site
USD 90,000 - 130,000
Remote: Engineering Benchmark & Question Authoring
Remote: Engineering Benchmark & Question Authoring

Mercor • United States

Remote
USD 70,000 - 110,000
Fully remote
AI Assessment Specialist — PhD Trainer (Remote)
AI Assessment Specialist — PhD Trainer (Remote)

Mercor • Philadelphia

On-site
USD 50,000 - 70,000
Remote Applied Physics Benchmark Architect
Remote Applied Physics Benchmark Architect

Mercor • United States

Remote
USD 34,000 - 83,000
Economics PhD - Benchmark & Assessment Specialist (Remote)
Economics PhD - Benchmark & Assessment Specialist (Remote)

Mercor • Philadelphia

On-site
USD 83,000 - 152,000
Remote work
Flexible schedule
Remote AI Philosophy Benchmark Architect
Remote AI Philosophy Benchmark Architect

Mercor • United States

Remote
USD 60,000 - 85,000
Remote Applied Psychology Benchmark Architect
Remote Applied Psychology Benchmark Architect

Mercor • United States

Remote
USD 55,000 - 110,000
Remote Health AI Benchmark Architect
Remote Health AI Benchmark Architect

Mercor • United States

Remote
USD 55,000 - 110,000