Senior AI Quality Grader & Rater - Remote

Clera

United States

Remote

USD 69,000 - 165,000

Full time

44 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Clera Labs, Inc. is seeking a senior rater and reviewer for a fully remote role evaluating AI model outputs. You will rank expert-level answers, provide rationales, and calibrate grading standards across domains including math, code, law, medicine, and finance.

You will fact-check claims, ensure alignment with policies, and participate in live sessions to discuss search relevance and improve grading guidelines. A advanced degree or equivalent expertise is required.

Qualifications

  • 5+ years of professional experience in rating, review, editing, fact-checking, or trust and safety.
  • Native or near-native written English proficiency.
  • Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
  • Experience leading, reviewing, or mentoring other raters or reviewers.
  • An advanced degree, professional license, or deep domain working expertise.

Responsibilities

  • Rank and rate expert-level model answers using rubrics with written rationales.
  • Evaluate model reasoning across domains such as mathematics, code, law, medicine, or finance.
  • Fact-check detailed claims against primary sources for accuracy.
  • Assess answers against content policies, style guides, and edge cases.
  • Review other raters, calibrate standards, and refine grading guidelines.
  • Assess search relevance and share feedback in live sessions.

Skills

Experience rating & review
Fact-checking
Trust & safety
Domain expertise
English proficiency
Mentoring reviewers

Education

Advanced degree or professional license

Tools

AI data annotation
Preference ranking
Rubric grading
Process labeling
Search-quality rating

Job description

Clera Labs, Inc. is seeking a senior rater and reviewer for a fully remote role evaluating AI model outputs. You will rank expert-level answers, provide rationales, and calibrate grading standards across domains including math, code, law, medicine, and finance.

You will fact-check claims, ensure alignment with policies, and participate in live sessions to discuss search relevance and improve grading guidelines. A advanced degree or equivalent expertise is required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)
Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)

Clera • United States

Remote
USD 69,000 - 165,000
Senior AI Evaluation Architect - Remote
Senior AI Evaluation Architect - Remote

Clera • United States

Remote
USD 103,000 - 241,000
Remote AI Evaluation & Testing Specialist
Remote AI Evaluation & Testing Specialist

Clera • United States

Remote
USD 41,000 - 83,000
Remote work
Remote Feedback & Alignment Specialist
Remote Feedback & Alignment Specialist

Clera • United States

Remote
USD 28,000 - 62,000
Competitive hourly pay
Fully remote work
Remote AI Quality Evaluator - CS Graduates
Remote AI Quality Evaluator - CS Graduates

prolificacademicltd • United States

Remote
USD 68,000 - 97,000
PayPal payments
Remote work
Remote AI Evaluation & Feedback Associate
Remote AI Evaluation & Feedback Associate

Clera • United States

Remote
USD 28,000 - 62,000
Senior AI Prompt Engineer & Content Reviewer (Remote)
Senior AI Prompt Engineer & Content Reviewer (Remote)

Clera • United States

Remote
USD 83,000 - 207,000
Senior QA Rater — Remote AI & Search Quality
Senior QA Rater — Remote AI & Search Quality

TELUS Digital • United States

Remote
USD 21,000 - 34,000
Senior QA Rater: Remote AI & Search Quality
Senior QA Rater: Remote AI & Search Quality

TELUS Digital • United States

Remote
USD 24,000 - 35,000
Senior QA Rater — AI & Search Quality (Remote)
Senior QA Rater — AI & Search Quality (Remote)

Jobs for Humanity • Germantown (MD)

Remote
USD 31,000 - 34,000