PhD Physicist AI Evaluator - $90-$140/hr Career Pivot

Weekday

United States

Remote

USD 124,000 - 193,000

Part time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Weekday is seeking highly experienced PhD Physicists and senior researchers to contribute scientific expertise to the development, evaluation, and benchmarking of next-generation AI models. You will assess physics-related tasks, design rigorous problem specifications, and create reference solutions.

The role is fully remote in the United States as an independent contractor, offering flexible schedules and weekly payments.

Qualifications

  • PhD in Physics, Astrophysics, Applied Physics, or a closely related discipline.
  • Senior-level academic or research experience (e.g., university faculty, PI, staff scientist).
  • Hands-on experience using Large Language Models (LLMs) in research or scientific workflows.
  • Excellent written communication and ability to craft precise problem statements and feedback.

Responsibilities

  • Expert Evaluation: review physics-related tasks for accuracy and rigor.
  • Problem Design: develop precise physics problem statements and specs.
  • Reference Solutions: create rigorous, well-reasoned solutions and methodologies.
  • Benchmark Development: design complex physics problems and evaluation datasets.
  • Scientific Assessment: evaluate AI-generated reasoning for validity and correctness.
  • Research Collaboration: work with AI researchers to set evaluation standards and quality criteria.
  • Feedback & Calibration: translate expertise into structured feedback for improving AI reasoning.

Skills

LLMs experience
AI evaluation
Scientific writing
Critical thinking

Education

PhD in Physics or related field

Tools

LLMs tools

Job description

Compensation vs. Market: At $90–$140/hr on a contract basis, this is at the high end for academic consulting and AI evaluation roles. Senior physicists in academia typically earn $80k–$150k annually as employees; this contract rate — even at 20 hrs/week — can match or exceed that, making it an attractive supplement or bridge engagement.

Skills Developed: This role sits at a genuinely rare intersection of frontier AI development and deep physics expertise. You will build:

  • Practical experience with LLM evaluation methodologies and RLHF-adjacent workflows.
  • Expertise in AI benchmark design — a fast-growing field within ML research.
  • Transferable skills for roles at AI labs (OpenAI, Anthropic, DeepMind) or AI-focused research institutes.

Green Flags: Weekly payment via Stripe/Wise signals an organized, contractor-experienced client. The flexibility and no-proprietary-info clause are respectful of academic commitments. This can be run in parallel with a faculty or research position.

Red Flags: The contract can be shortened or concluded early, offering no long‑term income security. There is no mention of IP ownership terms beyond the proprietary‑info clause — contractors should clarify who owns any benchmark datasets or problem sets created. The "client" anonymity is worth probing before signing.

Career Trajectory: This engagement is best viewed as a stepping stone into AI/ML research consulting or a full‑time role at an AI safety or alignment organization, where domain‑expert physicists are increasingly sought after.

This role is for one of our clients

Compensation: $90–$140 per hour

Employment Type: Contract (Independent Contractor)
Location: Remote (United States)
Work Arrangement: Fully Remote, Flexible Schedule

We are seeking highly experienced PhD Physicists and senior research professionals to contribute their scientific expertise to the development, evaluation, and advancement of next‑generation Artificial Intelligence (AI) models.

In this role, you will work alongside leading AI researchers to assess how advanced AI models understand and reason about complex physics concepts and real‑world scientific problems. You will leverage your research experience and specialized domain knowledge to evaluate physics‑related tasks, develop rigorous problem specifications, create reference solutions, and design challenging benchmarks that measure the scientific reasoning capabilities of AI systems.

The ideal candidate will be an established physicist with a strong academic or research background, deep specialization in at least one area of physics, and hands‑on experience using large language models (LLMs).

Key Responsibilities
  • Expert Evaluation: Review physics‑related tasks and AI‑generated outputs for scientific accuracy, logical consistency, and mathematical rigor.
  • Identify flawed derivations, unjustified assumptions, inappropriate approximations, dimensional inconsistencies, and errors in boundary or limiting cases.
  • Problem Design: Develop precise, research‑level physics problem statements and detailed specifications that reflect real‑world scientific challenges.
  • Reference Solutions: Create rigorous reference solutions, demonstrating correct scientific reasoning, mathematical derivations and appropriate methodologies.
  • Benchmark Development: Design complex physics problems and evaluation datasets within your area of specialization to assess and improve AI model performance.
  • Scientific Assessment: Evaluate AI‑generated reasoning and distinguish scientifically valid arguments from responses that appear convincing but contain conceptual or mathematical errors.
  • Research Collaboration: Work with AI researchers and subject matter experts across related disciplines to establish clear evaluation standards and measurable quality criteria.
  • Feedback & Calibration: Translate specialized scientific knowledge and expert judgment into structured feedback and evaluation frameworks that improve AI reasoning capabilities.
Required Qualifications
  • PhD in Physics, Astrophysics, Applied Physics, or a closely related discipline.
  • Senior‑level academic or research experience, such as:
    • Faculty appointment at a recognized university.
    • Principal Investigator (PI).
    • Staff Scientist or Senior Scientist.
    • Equivalent senior research position at a university, national laboratory, or established research organization.
  • Deep specialization in at least one of the following physics domains:
    • Condensed Matter Physics
    • High‑Energy Physics / Particle Physics
    • Astrophysics and Cosmology
    • Atomic, Molecular, and Optical (AMO) Physics
    • Quantum Physics
    • Statistical Physics
    • Computational Physics
    • Applied Physics
  • Strong peer‑reviewed research publication record.
  • Recognition through competitive research fellowships, academic awards, grants, or other scientific achievements is an added advantage.
  • Hands‑on experience using Large Language Models (LLMs) and AI tools in research or scientific workflows.
  • Ability to critically evaluate AI‑generated scientific arguments, mathematical derivations, and technical explanations.
  • Excellent written communication skills with the ability to develop precise problem statements and structured technical feedback.
  • Must be currently based in the United States.
Contract & Payment Terms
  • Engagement will be on an independent contractor basis.
  • The position is fully remote and offers flexibility to complete assignments according to your own schedule and project requirements.
  • Project timelines may be extended, shortened, or concluded early depending on business requirements and individual performance.
  • The engagement will not require access to confidential or proprietary information belonging to any current or former employer, client, university, or research institution.
  • Payments will be processed weekly via Stripe or Wise based on services rendered.
  • H‑1B and STEM OPT visa holders cannot be accommodated for this opportunity.

Do I need to work set hours or in a specific timezone? No — the role is explicitly described as flexible, allowing you to complete assignments according to your own schedule. There are no stated timezone or fixed‑hour requirements. What is the pay rate and how often are contractors paid? The compensation is $90–$140 per hour. Payments are processed weekly through either Stripe or Wise based on services rendered. Can I take this contract while holding a university faculty or staff scientist position? The role is designed to not require access to any confidential information from your current employer, which is intended to allow concurrent employment. However, you should review your institution's conflict‑of‑interest and outside‑employment policies before proceeding. How long does the contract last? Project duration is not fixed — timelines may be extended, shortened, or concluded early depending on business needs and individual performance, so there is no guaranteed minimum engagement length.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

PhD Physicist, AI Expert (Remote, US)
PhD Physicist, AI Expert (Remote, US)

Weekday • Oregon

Hybrid
USD 124,000 - 193,000
PhD Physicist, AI Expert (Remote, US)
PhD Physicist, AI Expert (Remote, US)

Weekday AI • United States

Remote
USD 124,000 - 193,000
Physics Expert (PhD / Postdoc)
Physics Expert (PhD / Postdoc)

Weekday AI • United States

Remote
USD 138,000 - 234,000
Physicist, PhD
Physicist, PhD

Alignerr • United States

Remote
USD 83,000 - 165,000
Physics Expert or Specialist
Physics Expert or Specialist

Alignerr • United States

Remote
USD 83,000 - 165,000
Applied Physics Specialist
Applied Physics Specialist

Alignerr Corp. • Sheffield (TX)

Remote
USD 83,000 - 165,000
Applied Physics
Applied Physics

Alignerr Corp. • Sheffield (TX)

Remote
USD 124,000 - 220,000
Fully remote
Flexible hours
Freelance autonomy
+1
Applied Physics Specialist
Applied Physics Specialist

Alignerr • United States

Remote
USD 83,000 - 165,000
Physics AI Trainer (PhD)
Physics AI Trainer (PhD)

Weekday AI • United States

Remote
USD 96,000 - 117,000
Remote work
Independent contractor
Remote Physics Researcher (PhD)
Remote Physics Researcher (PhD)

Turing • New York (NY)

Remote
USD 113,652 - 161,868