Remote AI Research Evaluation Specialist (PhD)

Auraone

United States

Remote

USD 141,000 - 190,000

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AI Trainer Jobs is seeking a Research Evaluation Specialist (PhD / Researcher / Professor) for remote, contractor work to evaluate AI outputs across research evaluation workflows. The role involves grading derivations, reproducing key results, and documenting correct methods to train modeling teams.

Responsibilities include reviewing outputs, reproducing claims, flagging errors with severity tags, and documenting corrected reasoning for training datasets.

Qualifications

  • Graduate-level training or equivalent applied experience in research evaluation research review or a closely related field for Research Evaluation Specialist work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Review AI outputs against current research evaluation methods, conventions, and prior work for Research Evaluation Specialist assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.

Skills

Scientific reasoning
Method validation
Citation review
Quantitative analysis
Research evaluation review
AI model evaluation

Education

PhD or equivalent

Job description

AI Trainer Jobs is seeking a Research Evaluation Specialist (PhD / Researcher / Professor) for remote, contractor work to evaluate AI outputs across research evaluation workflows. The role involves grading derivations, reproducing key results, and documenting correct methods to train modeling teams.

Responsibilities include reviewing outputs, reproducing claims, flagging errors with severity tags, and documenting corrected reasoning for training datasets.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Market Research Evaluation Specialist - AI Review
Remote Market Research Evaluation Specialist - AI Review

Auraone • United States

Remote
USD 55,000 - 83,000
Remote Research Evaluation Scientist (Contractor)
Remote Research Evaluation Scientist (Contractor)

AuraOne Human Data • United States

Remote
USD 55,000 - 110,000
PhD/academic experience preferred
Experience reviewing AI tools
Multilingual fluency (non-English)
Remote AI Research & Insights Auditor
Remote AI Research & Insights Auditor

Auraone • United States

Remote
USD 152,000 - 207,000
Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
Research Evaluation Specialist (PhD or Masters / Researcher / Professor)

AuraOne, Inc. • United States

Remote
USD 55,000 - 110,000
PhD/academic experience preferred
Experience reviewing AI tools
Multilingual fluency (non-English)
Remote AI Research Review Specialist (UK Markets)
Remote AI Research Review Specialist (UK Markets)

Auraone • United States

Remote
USD 179,000 - 214,000
Remote work
Remote Research Scientist — AI Research Evaluator
Remote Research Scientist — AI Research Evaluator

OpenTrain AI • United States

Remote
USD 138,000 - 551,000
Fully remote
Flexible schedule
Independent contractor
Remote AI Research & Reasoning Reviewer
Remote AI Research & Reasoning Reviewer

Auraone • United States

Remote
USD 136,000 - 194,000
Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
Research Evaluation Specialist (PhD or Masters / Researcher / Professor)

confidential • United States

Remote
USD 55,000 - 83,000
AI Research Review Specialist (Paid, In-Person)
AI Research Review Specialist (Paid, In-Person)

Auraone • United States

Remote
USD 70,000 - 94,000
Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
Research Evaluation Specialist (PhD or Masters / Researcher / Professor)

Micro1 • United States

Remote
USD 83,000 - 165,000
Remote work worldwide
Part-time contractor (~15 hrs/wk)
Flexible start and onboarding