Remote Physicist: AI Reasoning Auditor & Problem Setter

DataAnnotation; Kentucky; Remote; USD 55,000 - 172,000; Full time

Job summary

DataAnnotation is seeking a Physicist to evaluate AI reasoning across mechanics, E&M, quantum, and thermodynamics, and to write solutions with the care of a good problem-set grader.

You’ll craft problems exposing weak reasoning, review AI solutions for dimensional errors and skipped steps, and rate the reasoning. You’ll also write the gold-standard solution when the model falls short, showing physics clearly at every step.

Qualifications

• Graduate-level physics background or equivalent research experience.
• Clear written English in explanations.
• No degree required; focus on demonstrable ability to perform tasks.

Responsibilities

• Craft problems that expose weak physical reasoning, from undergraduate mechanics to graduate-level theory.
• Review AI solutions for dimensional errors, misapplied approximations, and skipped steps, and rate the reasoning.
• Write the gold-standard solution when the model falls short, showing the physics clearly at every step.

Skills

Graduate-level physics

Clear written English

Problem-solving across core physics

Education

Graduate-level physics background or equivalent research experience

Job description

DataAnnotation is seeking a Physicist to evaluate AI reasoning across mechanics, E&M, quantum, and thermodynamics, and to write solutions with the care of a good problem-set grader.

You’ll craft problems exposing weak reasoning, review AI solutions for dimensional errors and skipped steps, and rate the reasoning. You’ll also write the gold-standard solution when the model falls short, showing physics clearly at every step.