Senior Expert: Model Answer Evaluator & Calibration Lead

Clera

United States

Remote

USD 69,000 - 165,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive pay
Fully remote

Job summary

Clera is seeking experienced evaluators to rank and rate expert-level model answers using detailed rubrics. You will assess reasoning across multiple domains, fact-check against sources, and ensure alignment with policies and style guides.

Remote work is fully supported, with compensation from $50 to $120 per hour based on hours worked. You will calibrate raters, develop guidelines, and provide live-session feedback to maintain quality across projects.

Qualifications

  • Native or near-native written English is required.
  • Experience grading expert-level answers against rubrics or style guides.
  • Experience leading or reviewing other raters.

Responsibilities

  • Rank and rate expert-level model answers using detailed rubrics.
  • Evaluate reasoning across mathematics, coding, law, medicine, and finance.
  • Fact-check complex claims against primary sources.
  • Assess answers against content policies and style guides.
  • Review other raters' work and calibrate grading standards.
  • Develop or refine grading guidelines.
  • Assess search relevance and provide feedback in live sessions.

Skills

English proficiency
Rubric-based grading
Reviewer leadership
Remote collaboration

Education

Advanced degree / professional license

Job description

Clera is seeking experienced evaluators to rank and rate expert-level model answers using detailed rubrics. You will assess reasoning across multiple domains, fact-check against sources, and ensure alignment with policies and style guides.

Remote work is fully supported, with compensation from $50 to $120 per hour based on hours worked. You will calibrate raters, develop guidelines, and provide live-session feedback to maintain quality across projects.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Rater & Reviewer — Remote Calibration Expert
Senior AI Rater & Reviewer — Remote Calibration Expert

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
Senior Rater & Quality Alignment Lead (5+ yrs)
Senior Rater & Quality Alignment Lead (5+ yrs)

Clera • United States

Remote
USD 90,000 - 130,000
Remote Senior Rater for AI Model Evaluation & Calibration
Remote Senior Rater for AI Model Evaluation & Calibration

pofft Technology Inc. • United States

Remote
USD 69,000 - 165,000
Senior Rater & AI Feedback Lead (Remote)
Senior Rater & AI Feedback Lead (Remote)

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
Flexible project durations
Expert Talent Pool, Feedback and Alignment (Senior Expert)
Expert Talent Pool, Feedback and Alignment (Senior Expert)

Clera • United States

Remote
USD 69,000 - 165,000
Competitive pay
Fully remote
Expert Talent Pool, Feedback and Alignment (Senior Expert)
Expert Talent Pool, Feedback and Alignment (Senior Expert)

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
AI Evaluation Specialist (Remote, Flexible Projects)
AI Evaluation Specialist (Remote, Flexible Projects)

Clera • United States

Remote
USD 41,000 - 83,000
Payment for hours worked
Fully remote
Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
Flexible project durations
Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

VettedBench • United States

Remote
USD 69,000 - 165,000
Remote work
Competitive pay
Flexible hours
Remote Feedback & Alignment Specialist
Remote Feedback & Alignment Specialist

Clera • United States

Remote
USD 28,000 - 62,000
Competitive hourly pay
Fully remote work