AI Evaluation Scientist (PhD) — Math & Frontiers Benchmarking

Obsidian; Miami (FL); On-site; USD 83,000 - 124,000; Part time

Job summary

Mercor is seeking PhD and Master’s scientists to author AI evaluation tasks for a new benchmark in scientific computing. You will source material, craft executable problems, and build the grading criteria to measure model performance on challenging scenarios.

You will calibrate prompts against frontier models, ensuring tasks remain difficult where state-of-the-art systems struggle, across two subdomains with a coding focus.

Qualifications

• PhD in mathematics, applied mathematics, computational mathematics, or a closely related field.
• Depth in at least two subdomains: numerical linear algebra, computational mechanics, or computational finance.
• Proficiency in Python or R for scientific computing.
• Experience with Git/GitHub and running code in Docker with pull-request workflows.

Responsibilities

• Source your own material from papers, Kaggle datasets, open-source repositories, or scenarios you design.
• Write scientific prompts based on the input.
• Build the grading criteria that define a correct answer.
• Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed.

Skills

Python

R

Git/GitHub

Education

PhD in mathematics / applied mathematics / computational mathematics

Tools

Docker

Job description

Mercor is seeking PhD and Master’s scientists to author AI evaluation tasks for a new benchmark in scientific computing. You will source material, craft executable problems, and build the grading criteria to measure model performance on challenging scenarios.

You will calibrate prompts against frontier models, ensuring tasks remain difficult where state-of-the-art systems struggle, across two subdomains with a coding focus.