Senior Rater & AI Feedback Lead (Remote)

Clera

United States

Remote

USD 69,000 - 165,000

Full time

42 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote
Flexible project durations

Job summary

Clera is seeking a senior rater and reviewer to evaluate AI model outputs from a remote position. You will calibrate graders, write rationales, and ensure high-quality results across specialized domains.

You’ll rank expert-level answers, fact-check against primary sources, and calibrate grading guidelines in collaboration with live feedback sessions. A strong English background and domain expertise are essential for success.

Qualifications

  • Minimum 5 years of professional experience in rating, review, or trust/safety.
  • Native or near-native English writing ability.
  • Experience grading expert-level answers against rubrics, policies, or style guides.
  • Experience leading or reviewing other raters (QA lead, rubric owner, or reviewer of reviewers).
  • Hands-on AI data annotation experience is a plus.

Responsibilities

  • Rank and rate expert-level model answers using rubrics and write clear rationales.
  • Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.
  • Fact-check complex claims against primary sources and verify accuracy.
  • Assess answers against content policies, style guides, and edge cases.
  • Review other raters' work, calibrate standards, and refine grading guidelines.
  • Assess search relevance and provide feedback in live sessions.

Skills

5+ years experience
Fluent English
Rubrics & policies
QA leadership
Advanced degree
AI data annotation

Education

Advanced degree or professional license

Job description

Clera is seeking a senior rater and reviewer to evaluate AI model outputs from a remote position. You will calibrate graders, write rationales, and ensure high-quality results across specialized domains.

You’ll rank expert-level answers, fact-check against primary sources, and calibrate grading guidelines in collaboration with live feedback sessions. A strong English background and domain expertise are essential for success.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Rater & Reviewer — Remote Calibration Expert
Senior AI Rater & Reviewer — Remote Calibration Expert

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
Remote Feedback & Alignment Specialist
Remote Feedback & Alignment Specialist

Clera • United States

Remote
USD 28,000 - 62,000
Competitive hourly pay
Fully remote work
Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
Flexible project durations
Remote Senior Rater for AI Model Evaluation & Calibration
Remote Senior Rater for AI Model Evaluation & Calibration

pofft Technology Inc. • United States

Remote
USD 69,000 - 165,000
Expert Talent Pool, Feedback and Alignment (Senior Expert)
Expert Talent Pool, Feedback and Alignment (Senior Expert)

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

VettedBench • United States

Remote
USD 69,000 - 165,000
Remote work
Competitive pay
Flexible hours
Senior Rater & Quality Alignment Lead (5+ yrs)
Senior Rater & Quality Alignment Lead (5+ yrs)

Clera • United States

Remote
USD 90,000 - 130,000
Remote AI Quality Evaluator (0-5 yrs) – Project-Based
Remote AI Quality Evaluator (0-5 yrs) – Project-Based

Clera • United States

Remote
USD 28,000 - 62,000
Pay rate $20–$45/hr
Fully remote, project-based
Remote AI Evaluation Associate (0-5 yrs)
Remote AI Evaluation Associate (0-5 yrs)

Clera • United States

Remote
USD 28,000 - 62,000
Remote AI Evaluation & Testing Specialist
Remote AI Evaluation & Testing Specialist

Clera Labs, Inc. • United States

Remote
USD 41,000 - 83,000
Remote work