Frontier AI Research Evaluator — Member of Technical Staff (Remote)

AuraOne Human Data

United States

Remote

USD 55,000 - 138,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne, Inc. seeks a Frontier AI Research Evaluator — Member of Technical Staff (Remote) to assess AI outputs, reproduce key derivations, and document the correct method so the modeling team can train on them.

As a contractor, you will review reasoning, flag dimensional and citation issues, and provide worked examples. The role requires strong scientific reasoning, clear written communication, and reliable async availability for at least 10 hours per week; US work authorization is required.

Qualifications

  • Graduate-level training or equivalent applied experience in MT Realm Lab research review or related field.
  • Experience publishing, teaching, or advising on the topic at a professional level.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.
  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Responsibilities

  • Review AI outputs against current member of technical staff realm lab research review methods, conventions, and prior work for Frontier AI Research Evaluator — Member of Technical Staff (Remote) assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Scientific reasoning
Method validation
Citation review
Quantitative analysis
AI model evaluation
Independent contractor work

Education

Graduate-level training or equivalent

Job description

Frontier AI Research Evaluator — Member of Technical Staff (Remote) is a remote review track for evaluating AI outputs across member of technical staff realm lab research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Member of Technical Staff Realm Lab research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities
  • Review AI outputs against current member of technical staff realm lab research review methods, conventions, and prior work for Frontier AI Research Evaluator — Member of Technical Staff (Remote) assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
  • Graduate-level training or equivalent applied experience in member of technical staff realm lab research review or a closely related field for Frontier AI Research Evaluator — Member of Technical Staff (Remote) work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.
Example tasks
  • Reproduce a member of technical staff realm lab research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.
Skills
  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Member of Technical Staff Realm Lab research review
  • AI model evaluation
Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Frontier AI Research (Remote)
Member of Technical Staff, Frontier AI Research (Remote)

AuraOne Human Data • United States

Remote
USD 83,000 - 138,000
Member of Technical Staff, Applied AI Research (Remote)
Member of Technical Staff, Applied AI Research (Remote)

AuraOne Human Data • United States

Remote
USD 55,000 - 110,000
Member of Technical Staff, Cortex Lab (applied AI research)
Member of Technical Staff, Cortex Lab (applied AI research)

AuraOne Human Data • United States

Remote
USD 83,000 - 124,000
Member of Technical Staff, Model Training (applied research)
Member of Technical Staff, Model Training (applied research)

AuraOne, Inc. • United States

Remote
USD 83,000 - 165,000
Member of Technical Staff, Model Training (post-training research)
Member of Technical Staff, Model Training (post-training research)

AuraOne, Inc. • United States

Remote
USD 83,000 - 138,000
Remote Frontier AI Research Evaluator – Staff Scientist
Remote Frontier AI Research Evaluator – Staff Scientist

AuraOne Human Data • United States

Remote
USD 55,000 - 138,000
Engineering PhD — AI Technical Reasoning Review (Remote)
Engineering PhD — AI Technical Reasoning Review (Remote)

AuraOne Human Data • United States

Remote
USD 55,000 - 83,000
Remote contract
US-eligible
Flexible hours
Research Evaluation Specialist (PhD / Researcher / Professor)
Research Evaluation Specialist (PhD / Researcher / Professor)

Auraone • United States

Remote
USD 141,000 - 190,000
Member of Technical Staff, Coding Agent Research & Evaluations
Member of Technical Staff, Coding Agent Research & Evaluations

AuraOne Human Data • United States

Remote
USD 55,000 - 96,000
Prior experience training
AI workflow tooling familiarity
Bilingual experience for cross-region
Robotics & Embodied AI Research Evaluator — Member of Technical Staff
Robotics & Embodied AI Research Evaluator — Member of Technical Staff

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000