AI Benchmark Designer: Computational Statistics Expert

Mercor; Seattle (WA); On-site; USD 60,000 - 120,000; Part time

Job summary

Mercor in Seattle seeks a Computational Statistics and Applied Mathematics Expert to design graduate-level problems for benchmarking AI systems on real scientific workflows. You will craft challenging tasks that employ simulations, interpretation of results, and careful experiment design using specialized software.

You should hold an MS or PhD in statistics or applied mathematics (or equivalent) with hands-on coding experience in one or more specialised packages.

Qualifications

• Graduate-level training in statistics, applied mathematics, or a closely related field.
• Hands-on experience with specialized computational packages used for advanced modelling.
• Proven ability to design challenging graduate-level problems for AI benchmarking.
• Strong coding skills in Python or R and clear documentation of work.

Responsibilities

• Design graduate-level computational problems requiring real scientific workflows.
• Test problems against state-of-the-art AI models and refine difficulty.
• Create clear evaluation criteria and solution validators for reproducibility.

Skills

Problem design

Independent work

Python proficiency

Statistical reasoning

Education

MS or PhD in statistics / applied mathematics

Tools

rstan

brms

lavaan

OpenMx

Python (SciPy/pandas)

Pymc3/PyMC

Job description

Mercor in Seattle seeks a Computational Statistics and Applied Mathematics Expert to design graduate-level problems for benchmarking AI systems on real scientific workflows. You will craft challenging tasks that employ simulations, interpretation of results, and careful experiment design using specialized software.

You should hold an MS or PhD in statistics or applied mathematics (or equivalent) with hands-on coding experience in one or more specialised packages.