Remote Physics AI Benchmark Engineer (PhD)

Weekday AI; United States; Remote; USD 83,000 - 117,000; Part time

Job summary

Weekday AI is seeking PhD or Master's scientists to author AI evaluation tasks (Sci Code) for a new benchmark in scientific computing. You will craft executable research problems that frontier models currently cannot solve, sourcing material from papers, datasets, or original scenarios.

The role emphasizes creating prompts, grading criteria, and calibration against strong models, in a fully remote, part-time capacity.

Qualifications

• PhD in physics or closely related field.
• Depth in at least two subdomains: condensed matter, optics, quantum information/computing, computational physics, astrophysics, particle physics.
• Working proficiency in Python, R, or another relevant programming language for scientific computing.
• Comfortable with Git/GitHub and running code in Docker — authoring runs through a pull‑request workflow with automated quality checks.

Responsibilities

• Source your own material: a published paper, a Kaggle dataset, an open-source repository, or a scenario you design.
• Write scientific prompts based on the input.
• Build the grading criteria that define a correct answer.
• Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed.

Skills

Python

R

Scientific computing

Education

PhD in physics or related field

Master's in physics or related field

Tools

Git/GitHub

Docker

Job description

Weekday AI is seeking PhD or Master's scientists to author AI evaluation tasks (Sci Code) for a new benchmark in scientific computing. You will craft executable research problems that frontier models currently cannot solve, sourcing material from papers, datasets, or original scenarios.

The role emphasizes creating prompts, grading criteria, and calibration against strong models, in a fully remote, part-time capacity.