Applied Statistics and Computational Benchmark Designer

Mercor; Greater London; On-site; GBP 60,000 - 90,000; Full time

Job summary

Mercor is seeking a Computational Statistics and Applied Mathematics Expert to design graduate‑level problems for evaluating AI systems. You will create challenging computational tasks that use real scientific software, run simulations, interpret results, and design experiments.

You will modify problems through testing loops against state‑of‑the‑art models, refine difficulty, and ensure reproducibility. Proficiency with R/Python packages (rstan, brms, TAM, lavaan) and MATLAB/Scilab is valued,

Qualifications

• Graduate-level training in statistics, applied mathematics, or a related field.
• Hands-on experience with specialized computational packages demonstrated in research or work.
• Strong Python skills for problem setup, oracle functions, and validators.

Responsibilities

• Design graduate-level problems requiring skilled use of statistical and scientific software.
• Develop tasks that require multi-step workflows and strategic experimentation.
• Refine problems through testing loops against state-of-the-art AI models.
• Ensure reproducibility and proper interpretation of results.

Skills

Python programming

Statistics

Applied mathematics

Education

MS or PhD in statistics or applied mathematics

Tools

R

Stan / cmdstanr

brms

TAM / lavaan

MATLAB / Scilab

Job description

Mercor is seeking a Computational Statistics and Applied Mathematics Expert to design graduate‑level problems for evaluating AI systems. You will create challenging computational tasks that use real scientific software, run simulations, interpret results, and design experiments.

You will modify problems through testing loops against state‑of‑the‑art models, refine difficulty, and ensure reproducibility. Proficiency with R/Python packages (rstan, brms, TAM, lavaan) and MATLAB/Scilab is valued,