Remote Physicist for AI Evaluation & Standards

SaidGig; New York (NY); Remote; USD 96,000 - 138,000; Part time

Job summary

SaidGig in the United States is seeking a physics-minded expert contractor to help evaluate frontier AI systems. Your work will involve creating physics problems, reviewing AI-generated derivations, and developing standards for assessing physics reasoning and numerical outputs.

You will articulate judgment criteria and provide reference answers, with emphasis on correct units, limiting cases, and appropriate scaling. Remote, hourly independent contractor role offering project-based invitations.

Qualifications

• Graduate degree in physics or related field with research experience.
• Experience performing derivations and analysis independently.
• Ability to explain judgments clearly in writing.
• Comfort with ambiguous tasks and raising unclear instructions when needed.

Responsibilities

• Create physics problems from your area of expertise, including the system, assumptions, applicable regime, and a reference answer for evaluation.
• Review AI-generated derivations and numerical work for valid approximations, sound limiting cases, correct units, and appropriate scaling.
• Identify cases where an AI system reaches a correct expression using reasoning that would fail if the underlying assumptions changed.
• Provide the expert standards and reasoning used to assess advanced AI physics outputs.

Skills

Clear written communication

Analytical reasoning

Education

Graduate degree in physics or related field

Job description

SaidGig in the United States is seeking a physics-minded expert contractor to help evaluate frontier AI systems. Your work will involve creating physics problems, reviewing AI-generated derivations, and developing standards for assessing physics reasoning and numerical outputs.

You will articulate judgment criteria and provide reference answers, with emphasis on correct units, limiting cases, and appropriate scaling. Remote, hourly independent contractor role offering project-based invitations.