Quantum AI Benchmark Scientist

Obsidian; New York (NY); Remote; USD 83,000 - 138,000; Full time

Job summary

Mercor is seeking PhD or Master's level scientists to author AI evaluation tasks for Sci Code in a 6-week, part-time engagement. You will source materials, craft executable research problems, and design grading criteria, calibrating prompts against frontier models.

Start date is immediate and the work requires proficiency in Python or R and Docker-based workflows. The role emphasizes independent material sourcing, structured prompt creation, and rigorous evaluation pipelines within a

Qualifications

• PhD in physics, applied physics, or a closely related field.
• Depth in at least two subdomains: condensed matter, optics, quantum information/computing, computational physics, astrophysics, particle physics.
• Working proficiency in Python, R, or another language for scientific computing.
• Comfortable with Git/GitHub and running code in Docker—authoring runs through PR workflows with automated quality checks.

Responsibilities

• Source your own material: a published paper, a Kaggle dataset, an open-source repository, or a scenario you design.
• Write scientific prompts based on the input.
• Build the grading criteria that define a correct answer.
• Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed.

Skills

Python

Git/GitHub

Scientific computing

Education

PhD in Physics or closely related field

Tools

Docker

Git/GitHub

Job description

Mercor is seeking PhD or Master's level scientists to author AI evaluation tasks for Sci Code in a 6-week, part-time engagement. You will source materials, craft executable research problems, and design grading criteria, calibrating prompts against frontier models.

Start date is immediate and the work requires proficiency in Python or R and Docker-based workflows. The role emphasizes independent material sourcing, structured prompt creation, and rigorous evaluation pipelines within a