GenAI Benchmark Research Scientist - Remote (35h/wk)

Mercor; San Francisco (CA); Remote; USD 120,000 - 180,000; Full time

Job summary

Mercor is seeking a researcher to join its GenAI team to translate the scientific method into complex, multi-step tasks and to design studies, write Python-based solutions, and perform rigorous data analysis.

You will work remotely within the United States, about 35 hours per week, collaborating with researchers to ensure consistent, high-quality benchmark design and evaluation of frontier models.

Qualifications

• MSc or PhD in a STEM field or in a computational social-science or humanities discipline, or equivalent research-heavy experience with data analysis and coding.
• 1+ years in an active research role (academia, industry, or national labs).
• Your own research involves significant computational work: Python-based analysis, simulation, modeling, or data pipelines.
• Strong grounding in experimental design, hypothesis testing, and rigorous evaluation of results.
• Working familiarity with Git, IDEs, and notebook environments (Jupyter or Colab).
• Past experience in AI training, model evaluation, or benchmark/task authoring is preferred.
• A perfectionist mindset: high attention to detail, creativity in task design, strong written communication, and ability to work independently through ambiguous problems.
• Ability to engage reliably for approximately 35 hours per week.

Responsibilities

• Design tasks by turning research skills into engaging, multi-step tasks.
• Author solutions in Python notebooks with rigorous standards.
• Define criteria for good scientific reasoning and evaluation.
• Evaluate model attempts and surface mistakes a working researcher would spot.
• Collaborate with researchers to keep evaluations consistent and accurate.

Skills

Python

Experimental design

Data analysis

Written communication

Independent work

Education

MSc or PhD in STEM or computational social science or humanities

Tools

Git

Jupyter/Colab

Job description

Mercor is seeking a researcher to join its GenAI team to translate the scientific method into complex, multi-step tasks and to design studies, write Python-based solutions, and perform rigorous data analysis.

You will work remotely within the United States, about 35 hours per week, collaborating with researchers to ensure consistent, high-quality benchmark design and evaluation of frontier models.