Lead Physics Auditor for Terminal Bench Science

Turing; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

Turing is seeking an experienced Physics expert to lead a pod of trainers in building realistic, terminal-based scientific tasks for Terminal Bench Science. You will review each task for physical correctness, reproducibility, and grader reliability, and coach trainers to consistently deliver high-quality, challenging tasks.

Responsibilities include end-to-end task review, ensuring authentic physics workflows, and preventing gaming through hard-coded outputs, with emphasis on clear documentation

Qualifications

• Ph.D./Postdoc or equivalent advanced physics experience.
• Strong programming skills in Python/C/C++, Julia, or Fortran; Linux proficiency.

Responsibilities

• Review trainer tasks end to end: statements, datasets, simulations, reference solutions, tests.
• Verify tasks reflect authentic physics workflows and require multi-step reasoning.
• Check that tools and dependencies are pinned and results are reproducible.
• Validate dimensional consistency, unit systems, conservation laws, and numerical stability.
• Ensure graders verify observables, uncertainties, or physical invariants rather than formatting.
• Prevent hard-coded outputs or bypassed computation and provide actionable feedback.

Skills

Python

C/C++

Julia

Fortran

Linux

Education

Ph.D./Postdoc in Physics

Tools

QuTiP

Qiskit

Kwant

ITensor

ROOT

Geant4

Astropy

Dedalus

MEEP

Docker

Git

CI systems

Job description

Turing is seeking an experienced Physics expert to lead a pod of trainers in building realistic, terminal-based scientific tasks for Terminal Bench Science. You will review each task for physical correctness, reproducibility, and grader reliability, and coach trainers to consistently deliver high-quality, challenging tasks.

Responsibilities include end-to-end task review, ensuring authentic physics workflows, and preventing gaming through hard-coded outputs, with emphasis on clear documentation