Mathematics PhD: AI Evaluation Scientist (Remote, 6-wk)

Mercor; San Francisco (CA); Hybride; GBP 62 000 - 92 000; Temps partiel

Résumé du poste

Mercor seeks a Mathematics PhD Coding Expert for a 6-week remote contract. The role requires developing datasets and prompts to challenge frontier AI models, with tasks graded against defined criteria and calibrated against model performance. You will work independently, contributing to AI research at an elite level.

Immediate start, 20+ hours/week. Strong background in numerical linear algebra or related fields, and proficiency in Python or R, plus GitHub and Docker experience, are essential.

Qualifications

• PhD in mathematics, applied mathematics, computational mathematics, or closely related field.
• Depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
• Proficiency in Python or R for scientific computing.
• Experience with Git/GitHub and Docker.

Responsabilités

• Source original material from published papers, Kaggle datasets, open-source repositories, or self-designed scenarios.
• Write scientific prompts based on sourced input to challenge frontier models.
• Build grading criteria that define correct answers for scientific tasks.
• Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Connaissances

Asynchronous work

Scientific computing mindset

Formation

PhD in mathematics

Outils

Python

R

Git/GitHub

Docker

Description du poste

Mercor seeks a Mathematics PhD Coding Expert for a 6-week remote contract. The role requires developing datasets and prompts to challenge frontier AI models, with tasks graded against defined criteria and calibrated against model performance. You will work independently, contributing to AI research at an elite level.

Immediate start, 20+ hours/week. Strong background in numerical linear algebra or related fields, and proficiency in Python or R, plus GitHub and Docker experience, are essential.