Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)

Clera

United States

Remote

USD 69,000 - 165,000

Full time

44 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Clera Labs, Inc. is seeking a senior rater and reviewer for a fully remote role evaluating AI model outputs. You will rank expert-level answers, provide rationales, and calibrate grading standards across domains including math, code, law, medicine, and finance.

You will fact-check claims, ensure alignment with policies, and participate in live sessions to discuss search relevance and improve grading guidelines. A advanced degree or equivalent expertise is required.

Qualifications

  • 5+ years of professional experience in rating, review, editing, fact-checking, or trust and safety.
  • Native or near-native written English proficiency.
  • Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
  • Experience leading, reviewing, or mentoring other raters or reviewers.
  • An advanced degree, professional license, or deep domain working expertise.

Responsibilities

  • Rank and rate expert-level model answers using rubrics with written rationales.
  • Evaluate model reasoning across domains such as mathematics, code, law, medicine, or finance.
  • Fact-check detailed claims against primary sources for accuracy.
  • Assess answers against content policies, style guides, and edge cases.
  • Review other raters, calibrate standards, and refine grading guidelines.
  • Assess search relevance and share feedback in live sessions.

Skills

Experience rating & review
Fact-checking
Trust & safety
Domain expertise
English proficiency
Mentoring reviewers

Education

Advanced degree or professional license

Tools

AI data annotation
Preference ranking
Rubric grading
Process labeling
Search-quality rating

Job description

About the Role

Join a remote expert network as a senior rater and reviewer, evaluating challenging AI model outputs and helping calibrate other graders. Your work supports the development of reliable, high-quality AI systems.

What You'll Do
  • Rank and rate expert-level model answers in your domain using detailed rubrics and written rationales.

  • Evaluate model reasoning step by step in specialized fields such as mathematics, code, law, medicine, or finance.

  • Fact-check detailed claims against primary sources and verify accuracy.

  • Assess answers against content policies, style guides, and edge cases.

  • Review other raters' work, calibrate standards, and develop or refine grading guidelines.

  • Assess search relevance and share feedback in live sessions.

What We’re Looking For
  • At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or deep expertise in a relevant field.

  • Native or near-native written English proficiency.

  • Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.

  • Experience leading, reviewing, or mentoring other raters or reviewers.

  • An advanced degree, professional license, or deep working expertise in the domain you evaluate.

  • Hands-on experience with AI data annotation, preference ranking, rubric grading, process labeling, or search-quality rating is a plus.

Compensation & Benefits

Compensation is $50 to $120 per hour, depending on project, field, and expertise. Payment is for hours worked.

Location

Fully remote. Projects typically last from one week to several months.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Expert Talent Pool, Feedback and Alignment Associate
Expert Talent Pool, Feedback and Alignment Associate

Clera • United States

Remote
USD 28,000 - 62,000
Expert Talent Pool, Feedback and Alignment Associate
Expert Talent Pool, Feedback and Alignment Associate

Clera • United States

Remote
USD 28,000 - 62,000
Competitive hourly pay
Fully remote work
Expert Talent Pool, Evals and Benchmarks (Associate)
Expert Talent Pool, Evals and Benchmarks (Associate)

Clera • United States

Remote
USD 41,000 - 83,000
Remote work
Expert Talent Pool, Generation and Writing (Senior)
Expert Talent Pool, Generation and Writing (Senior)

Clera • United States

Remote
USD 83,000 - 207,000
Senior AI Quality Grader & Rater - Remote
Senior AI Quality Grader & Rater - Remote

Clera • United States

Remote
USD 69,000 - 165,000
Expert Talent Pool, Evals and Benchmarks
Expert Talent Pool, Evals and Benchmarks

Clera • United States

Remote
USD 103,000 - 241,000
Expert Talent Pool, Evals and Benchmarks (Associate)
Expert Talent Pool, Evals and Benchmarks (Associate)

Clera • United States

Remote
USD 41,000 - 83,000
Payment for hours worked
Fully remote
STEM Rubric Design Specialist
STEM Rubric Design Specialist

OpenTrain AI, Inc. • United States

Remote
USD 117,000 - 158,000
Remote work
Part-time contractor role
Domain Expert Reviewer - Fully Remote | Upto $85/Hr
Domain Expert Reviewer - Fully Remote | Upto $85/Hr

Mercor • San Francisco (CA)

Hybrid
GBP 73,000 - 89,000
Senior Economics Research Expert
Senior Economics Research Expert

Auraone • United States

Remote
USD 207,000 - 344,000