Quantum Computing AI Benchmark Designer

Mercor; Greater London; On-site; GBP 273,000 - 455,000; Part time

Job summary

Mercor is hiring PhD and Master's scientists to author AI evaluation tasks for Sci Code. You will author original, executable research problems that today's frontier models cannot solve.

Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will craft prompts and define grading criteria, calibrating against frontier models to ensure robust evaluation results.

Qualifications

• PhD in physics, applied physics, or closely related field.
• Depth in at least two subdomains: condensed matter, optics, quantum information/computing, etc.
• Proficiency in Python, R, or similar for scientific computing.
• Comfortable with Git/GitHub and Docker, PR workflow with automated checks.

Responsibilities

• Source your own material: a published paper, a Kaggle dataset, an open-source repository, or a scenario you design
• Write scientific prompts based on the input
• Build the grading criteria that define a correct answer
• Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed

Skills

Python

R

Scientific computing

Git/GitHub

Docker

Research methodology

Education

PhD in physics or related field

Master's in physics or closely related field

Tools

Docker

Git

Jupyter

Job description

Mercor is hiring PhD and Master's scientists to author AI evaluation tasks for Sci Code. You will author original, executable research problems that today's frontier models cannot solve.

Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will craft prompts and define grading criteria, calibrating against frontier models to ensure robust evaluation results.