Physicist for AI Benchmark Authoring and Verification

SaidGig; New York (NY); Remote; USD 84,000 - 106,000; Full time

Job summary

SaidGig in the United States (Remote) seeks a doctoral-level physicist to develop rigorous academic physics assessments that benchmark AI capabilities. This fully remote role involves either authoring original multiple-choice problems or verifying existing questions across advanced physics domains.

The work spans Semiconductor Physics, Nanoelectronics, Quantum Optics, and Geophysics, with responsibilities tailored to your strengths.

Qualifications

• PhD or current doctoral candidacy in Physics or a closely related field.
• Strong command of graduate-level physics concepts and mathematical formalism.
• Experience designing rigorous academic problems or writing physics olympiad questions.
• Excellent written English communication.

Responsibilities

• Complete one of two task types: authoring or verification.
• For authoring, create original MC questions, assess difficulty, and submit for review.
• For verification, evaluate pre-written questions for accuracy, clarity, rigor, solvability; revise and document the rationale for changes.
• Design questions that assess deep conceptual understanding rather than surface-level recall.
• Ensure every question is self-contained, unambiguous, and precisely defined with all information in the statement.
• Classify question difficulty as Medium, introductory undergraduate; Hard, advanced undergraduate; or Expert, postgraduate and above.
• Provide one correct answer and nine plausible, subtly incorrect alternatives.
• Write step-by-step solutions with clear, concise intermediate reasoning in Markdown format.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals or university repositories.

Skills

Academic writing

Clear communication

Physics problem design

Graduate-level physics concepts

Education

PhD in Physics

Master's in Physics (optional)

Job description

Role Overview

Develop rigorous academic physics assessments that help benchmark AI capabilities. This fully remote role involves either authoring original multiple-choice problems or verifying existing questions across advanced physics domains.

Physics Domains

• Semiconductor Physics
• Nanoelectronics and Spintronics
• Photonics
• Quantum Optics and Ultrafast Physics
• Quantum Sensing and Metrology
• Plasma Physics and Fusion Energy
• Nonlinear Dynamics and Turbulence
• Geophysics and Reservoir Simulation

Key Responsibilities

• Complete one of two task types: question authoring or question verification.
• For authoring assignments, create original, challenging multiple-choice questions in your physics specialty, assess their difficulty, and submit them for review.
• For verification assignments, evaluate pre-written questions for accuracy, clarity, rigor, completeness, precision, and solvability; revise them as needed and document the rationale for changes.
• Design questions that assess deep conceptual understanding rather than surface-level recall.
• Ensure every question is self-contained, unambiguous, and precisely defined, with all necessary information included in the problem statement.
• Classify question difficulty as Medium, introductory undergraduate; Hard, advanced undergraduate; or Expert, postgraduate and above.
• Provide one correct answer and nine plausible, subtly incorrect alternatives suitable for challenging expert-level solvers.
• Write step-by-step solutions with clear, concise intermediate reasoning in Markdown format.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals or university repositories.

Qualifications

• PhD or current doctoral candidacy in Physics, Applied Physics, Astrophysics, or a closely related field.
• A master''s degree may be considered for candidates with exceptional depth in a specific physics subdomain.
• Strong command of graduate-level physics concepts and mathematical formalism.
• Experience designing rigorous academic problems or writing physics olympiad questions is a strong advantage.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

Work Terms

• Remote, asynchronous hourly engagement.
• Expected commitment of at least 10 hours per week.

Compensation

$61 to $77 per hour.