Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)

Clera

United States

Remote

USD 90,000 - 130,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Clera is seeking a seasoned reviewer to rank and rate expert-level model answers using detailed rubrics and rationales. You will assess reasoning across math, code, law, medicine, and finance to ensure accuracy and consistency.

You will lead calibration of raters, review work of peers, and provide feedback in live sessions, helping refine grading guidelines and search relevance assessments.

Qualifications

  • At least 5 years of professional experience in rating, review, editing, fact-checking, or trust and safety.
  • Native or near-native written English proficiency.
  • Experience grading expert-level answers against rubrics, policies, or style guides.
  • Experience leading, reviewing, or mentoring other raters or reviewers.

Responsibilities

  • Rank and rate expert-level model answers using detailed rubrics and written rationales.
  • Evaluate model reasoning step by step in fields such as mathematics, code, law, medicine, or finance.
  • Fact-check detailed claims against primary sources.
  • Review other raters' work, calibrate standards, and refine grading guidelines.
  • Assess search relevance and share feedback in live sessions.

Skills

Rating & review experience
English proficiency
Mentoring raters
Rubrics & policies

Education

Advanced degree preferred

Job description

Responsibilities
  • Rank and rate expert-level model answers using detailed rubrics and written rationales
  • Evaluate model reasoning step by step in fields such as mathematics, code, law, medicine, or finance
  • Fact-check detailed claims against primary sources
  • Review other raters' work, calibrate standards, and refine grading guidelines
  • Assess search relevance and share feedback in live sessions
Requirements
  • At least 5 years of professional experience in rating, review, editing, fact-checking, or trust and safety
  • Native or near-native written English proficiency
  • Experience grading expert-level answers against rubrics, policies, or style guides
  • Experience leading, reviewing, or mentoring other raters or reviewers
Preferred Qualifications
  • Advanced degree, professional license, or deep working expertise in the evaluated domain
  • Experience with AI data annotation, preference ranking, or search-quality rating
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Expert Talent Pool, Feedback and Alignment (Senior Expert)
Expert Talent Pool, Feedback and Alignment (Senior Expert)

Clera • United States

Remote
USD 69,000 - 165,000
Competitive pay
Fully remote
Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
Flexible project durations
Expert Talent Pool, Feedback and Alignment (Senior Expert)
Expert Talent Pool, Feedback and Alignment (Senior Expert)

Clera • United States

Remote
USD 69,000 - 165,000
Fully remote
Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

VettedBench • United States

Remote
USD 69,000 - 165,000
Remote work
Competitive pay
Flexible hours
Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)
Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)

Clera • United States

Remote
USD 28,000 - 62,000
Pay rate $20–$45/hr
Fully remote, project-based
Expert Talent Pool, Feedback and Alignment Associate
Expert Talent Pool, Feedback and Alignment Associate

Clera • United States

Remote
USD 28,000 - 62,000
Competitive hourly pay
Fully remote work
Expert Talent Pool Feedback and Alignment
Expert Talent Pool Feedback and Alignment

pofft Technology Inc. • United States

Remote
USD 69,000 - 165,000
Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)
Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)

Clera • United States

Remote
USD 28,000 - 62,000
Expert Talent Pool, Generation and Writing (Senior)
Expert Talent Pool, Generation and Writing (Senior)

Clera • United States

Remote
USD 83,000 - 207,000
Hourly pay: $60-$150
Remote work
AI training project exposure
Senior Rater & Quality Alignment Lead (5+ yrs)
Senior Rater & Quality Alignment Lead (5+ yrs)

Clera • United States

Remote
USD 90,000 - 130,000