Remote Cosmology AI Evaluation Scientist

mercor; United States; Remote; USD 96,000 - 138,000; Full time

Job summary

Mercor is seeking a STEM Computational Scientific Software & Evaluation Designer focused on Astrophysics & Cosmology. This contract role is remote, offering 15–20 hours per week.

You will design graduate-level problems, evaluate AI systems on research-grade tasks, and calibrate datasets using Python and Astropy, operating in Linux environments. Remote work enables flexible collaboration across time zones.

Qualifications

• Graduate-level training in a STEM field (MS, PhD, or equivalent research experience).
• Proven track of using scientific software libraries in research.
• Strong Python programming for problem setups and validators.

Responsibilities

• Design graduate-level computational problems using domain-specific scientific software libraries.
• Evaluate AI systems' ability to solve research-grade problems and interpret outputs.
• Develop experimental strategies to recover hidden information from data with strategic reasoning.
• Calibrate tasks against state-of-the-art AI models to hit target difficulty.
• Work independently and asynchronously to iterate on problem designs.

Skills

Python programming

Linux/terminal

Scientific software libraries

Education

MS/PhD in a relevant STEM field

Tools

Astropy

Job description

Mercor is seeking a STEM Computational Scientific Software & Evaluation Designer focused on Astrophysics & Cosmology. This contract role is remote, offering 15–20 hours per week.

You will design graduate-level problems, evaluate AI systems on research-grade tasks, and calibrate datasets using Python and Astropy, operating in Linux environments. Remote work enables flexible collaboration across time zones.