Quantum Chemistry AI Benchmark Engineer (PhD, Python)

Mercor; San Diego (CA); On-site; USD 9,919,000 - 14,878,000; Part time

Job summary

Mercor is seeking PhD/Master's scientists to author AI evaluation tasks and build benchmarks for scientific computing. You will craft original, executable research problems that current frontier models struggle with, sourcing material from papers, datasets, or open-source repositories.

Collaboration with AI labs is expected. Responsibilities include writing prompts, designing grading criteria, and calibrating models to ensure robust evaluation.

Qualifications

• PhD in chemistry, physical chemistry, theoretical chemistry, computational chemistry.
• Depth in both quantum chemistry and computational chemistry.
• Proficiency in Python, R, or another scientific programming language.

Responsibilities

• Source your own material: a published paper, Kaggle dataset, open-source repository, or a scenario you design.
• Write scientific prompts based on the input.
• Build the grading criteria that define a correct answer.
• Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed.

Skills

Python

R

Git

Education

PhD in Chemistry/Computational Chemistry

Master's in Chemistry/Related Field

Tools

Docker

GitHub

Job description

Mercor is seeking PhD/Master's scientists to author AI evaluation tasks and build benchmarks for scientific computing. You will craft original, executable research problems that current frontier models struggle with, sourcing material from papers, datasets, or open-source repositories.

Collaboration with AI labs is expected. Responsibilities include writing prompts, designing grading criteria, and calibrating models to ensure robust evaluation.