Remote AI Benchmark Scientist — Math PhD

1000scholars; United States; Remote; USD 328,000 - 546,000; Part time

Job summary

Mercor is seeking PhD or Masters scientists to author AI evaluation tasks for a new Sci Code benchmark. Remote, independent contractor with a six-week, part-time commitment (20+ hours/week).

You will design problems in mathematics and related domains, source data, and establish grading criteria while calibrating against frontier models. Prior depth in numerical linear algebra, computational mechanics, or computational finance, plus Python or R proficiency, is required.

Qualifications

• PhD in mathematics, applied mathematics, computational mathematics, or closely related field.
• Depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
• Proficiency in Python or R for scientific computing.
• Familiarity with Git/GitHub and running code in Docker with PR workflow.

Responsibilities

• Source your own material: published paper, Kaggle dataset, open-source repo, or self-designed scenario.
• Write scientific prompts based on the input.
• Build the grading criteria that define a correct answer.
• Calibrate against frontier models so the task fails stronger than it succeeds.

Skills

Python

R

GitHub

Docker

Education

PhD in Mathematics

MS in related field

Tools

Docker

GitHub

Job description

Mercor is seeking PhD or Masters scientists to author AI evaluation tasks for a new Sci Code benchmark. Remote, independent contractor with a six-week, part-time commitment (20+ hours/week).

You will design problems in mathematics and related domains, source data, and establish grading criteria while calibrating against frontier models. Prior depth in numerical linear algebra, computational mechanics, or computational finance, plus Python or R proficiency, is required.