Physicist for AI Training and Evaluation

SaidGig; New York (NY); Remote; USD 96,000 - 138,000; Part time

Job summary

SaidGig in the United States is seeking a physics-minded expert contractor to help evaluate frontier AI systems. Your work will involve creating physics problems, reviewing AI-generated derivations, and developing standards for assessing physics reasoning and numerical outputs.

You will articulate judgment criteria and provide reference answers, with emphasis on correct units, limiting cases, and appropriate scaling. Remote, hourly independent contractor role offering project-based invitations.

Qualifications

• Graduate degree in physics or related field with research experience.
• Experience performing derivations and analysis independently.
• Ability to explain judgments clearly in writing.
• Comfort with ambiguous tasks and raising unclear instructions when needed.

Responsibilities

• Create physics problems from your area of expertise, including the system, assumptions, applicable regime, and a reference answer for evaluation.
• Review AI-generated derivations and numerical work for valid approximations, sound limiting cases, correct units, and appropriate scaling.
• Identify cases where an AI system reaches a correct expression using reasoning that would fail if the underlying assumptions changed.
• Provide the expert standards and reasoning used to assess advanced AI physics outputs.

Skills

Clear written communication

Analytical reasoning

Education

Graduate degree in physics or related field

Job description

Role Overview

Apply your physics judgment to help evaluate and improve frontier AI systems. Your expertise will inform the standards used to assess physics reasoning, derivations, numerical work, and model outputs.

Key Responsibilities

• Create physics problems from your area of expertise, including the system, assumptions, applicable regime, and a reference answer for evaluation.
• Review AI-generated derivations and numerical work for valid approximations, sound limiting cases, correct units, and appropriate scaling.
• Identify cases where an AI system reaches a correct expression using reasoning that would fail if the underlying assumptions changed.
• Provide the expert standards and reasoning used to assess advanced AI physics outputs.

Qualifications

• Graduate degree in physics or a related field, with research experience.
• Recent hands-on experience performing derivations and analysis independently, with the ability to explain the judgments made.
• Clear written communication skills.
• Comfort working with ambiguous tasks and raising unclear instructions when needed.

Work Terms

Remote, hourly independent contractor work. Project-specific invitations identify the rate, expected hours, and client. This listing itself does not result in an acceptance or rejection decision. Matching may occur within a week or take several months, depending on available projects.

Compensation

Past project rates have ranged from $70 to $100 per hour, based on project scope and depth.

Eligibility

Completing the domain-expert interview and joining each network for which you qualify can improve the likelihood of being matched. A single registration makes you eligible for opportunities across applicable networks.