AI Benchmark Scientist - Quantum & Computational Chemistry

Obsidian; Greater London; Remote; GBP 41,000 - 69,000; Part time

Job summary

Mercor is seeking PhD- and Master’s-level scientists to author AI evaluation tasks as part of a new Sci Code benchmark. You will craft original, executable research problems that current frontier models cannot solve and contribute to a benchmark for scientific computing with a focus on chemistry subdomains.

You will source material, write prompts, define grading criteria, and calibrate tasks against models that fail more often than succeed, in a collaborative experiment with leading AI labs.

Qualifications

• PhD in chemistry, physical chemistry, theoretical chemistry, computational chemistry, or a closely related field.
• Demonstrated depth in quantum chemistry and computational chemistry.
• Proficiency in Python, R, or another language for scientific computing.
• Comfortable with Git/GitHub and running code in Docker — PR workflow experience.

Responsibilities

• Source your own material from papers, Kaggle datasets, open-source repositories, or a scenario you design.
• Write scientific prompts based on the input.
• Build the grading criteria that define a correct answer.
• Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed.

Skills

Python

R

Git/GitHub

Docker

Education

PhD in chemistry or closely related field

Tools

Docker

Git/GitHub

Job description

Mercor is seeking PhD- and Master’s-level scientists to author AI evaluation tasks as part of a new Sci Code benchmark. You will craft original, executable research problems that current frontier models cannot solve and contribute to a benchmark for scientific computing with a focus on chemistry subdomains.

You will source material, write prompts, define grading criteria, and calibrate tasks against models that fail more often than succeed, in a collaborative experiment with leading AI labs.