Expert Talent Pool, Feedback and Alignment (Senior Expert)

Clera

United States

Remote

USD 69,000 - 165,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fully remote

Job summary

Clera Labs, Inc. is seeking a senior rater and reviewer to evaluate complex AI model outputs in a fully remote role. You will rate expert-level answers, justify your ratings with detailed rationales, and ensure alignment with rubrics, policies, and style guides.

You will also fact-check claims against primary sources, calibrate standards, and provide feedback during live sessions. Applicants should have extensive experience in rating, editing, and trust-and-safety domains.

Qualifications

  • Minimum 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or a relevant professional domain.
  • Native or near-native written English proficiency.
  • Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
  • Experience leading or reviewing other raters, such as QA lead, rubric owner, or reviewer of reviewers.
  • Hands-on AI data annotation experience or search-quality rating is a plus.

Responsibilities

  • Rank and rate expert-level model answers using detailed rubrics and write clear rationales.
  • Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.
  • Fact-check complex claims against primary sources and verify accuracy.
  • Assess answers against content policies, style guides, and edge cases.
  • Review other raters' work, calibrate standards, and develop or refine grading guidelines.
  • Assess search relevance and provide feedback in live sessions.

Skills

Rating and reviewing
Fact-checking
Editing
Trust and safety
Rater leadership

Education

Advanced degree or professional license

Tools

Rubrics
Style guides

Job description

About the Role

Join a remote expert network as a senior rater and reviewer, evaluating complex AI model outputs and helping calibrate other graders. Your work supports the development of high-quality, trustworthy AI systems across specialized fields.

What You'll Do
  • Rank and rate expert‑level model answers using detailed rubrics and write clear rationales.

  • Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.

  • Fact-check complex claims against primary sources and verify accuracy.

  • Assess answers against content policies, style guides, and edge cases.

  • Review other raters' work, calibrate standards, and develop or refine grading guidelines.

  • Assess search relevance and provide feedback in live sessions.

What We're Looking For
  • At least 5 years of professional experience in rating, review, editing, fact‑checking, trust and safety, or a relevant professional domain.

  • Native or near‑native written English proficiency.

  • Experience grading or reviewing expert‑level answers against rubrics, policies, or style guides.

  • Experience leading or reviewing other raters, such as as a QA lead, rubric owner, or reviewer of reviewers.

  • An advanced degree, professional license, or deep working expertise in the domain you grade.

  • Hands‑on AI data annotation experience, search‑quality rating, or experience writing and maintaining grader guidelines is a plus.

Compensation & Benefits

Compensation is $50 to $120 per hour, depending on the project, field, and expertise level. Payment is based on hours worked.

Location

Fully remote. Projects typically run from one week to several months.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
Flexible project durations
Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

VettedBench • United States

Remote
USD 69,000 - 165,000
Remote work
Competitive pay
Flexible hours
Expert Talent Pool, Feedback and Alignment (Senior Expert)
Expert Talent Pool, Feedback and Alignment (Senior Expert)

Clera • United States

Remote
USD 69,000 - 165,000
Competitive pay
Fully remote
Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

pofft Technology Inc. • United States

Remote
USD 69,000 - 165,000
Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)
Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)

Clera • United States

Remote
USD 90,000 - 130,000
Remote Senior Rater for AI Model Evaluation & Calibration
Remote Senior Rater for AI Model Evaluation & Calibration

pofft Technology Inc. • United States

Remote
USD 69,000 - 165,000
Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)
Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)

Clera • United States

Remote
USD 28,000 - 62,000
Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)
Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)

Clera • United States

Remote
USD 28,000 - 62,000
Pay rate $20–$45/hr
Fully remote, project-based
Expert Talent Pool, Feedback and Alignment Associate
Expert Talent Pool, Feedback and Alignment Associate

Clera • United States

Remote
USD 28,000 - 62,000
Competitive hourly pay
Fully remote work
Expert Talent Pool, Evals and Benchmarks (Associate)
Expert Talent Pool, Evals and Benchmarks (Associate)

Clera Labs, Inc. • United States

Remote
USD 41,000 - 83,000
Remote work