Remote AI Quality Evaluator (0-5 yrs) – Project-Based

Clera

United States

Remote

USD 28,000 - 62,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Pay rate $20–$45/hr
Fully remote, project-based

Job summary

Clera is seeking detail-oriented evaluators to rate and rank AI model responses. You will apply rubrics to assess accuracy, helpfulness, tone, and safety, labeling reasoning steps and fact-checking claims against sources.

Remote, project-based work with flexible hours, lasting from one week to several months. Candidates should have five years or less of relevant experience, strong English writing, and the ability to consistently apply guidelines across many items.

Qualifications

  • Zero to five years of relevant professional experience.
  • Native or near-native written English.
  • Meticulous attention to detail.
  • Experience rating, reviewing, fact-checking, editing, or grading against guidelines.
  • Degree or background in a field you can evaluate.
  • Ability to apply rubrics consistently across many items.

Responsibilities

  • Compare and rank model responses for relative quality.
  • Rate answers for accuracy, helpfulness, tone, and safety using rubrics.
  • Label reasoning steps as correct or incorrect with concise rationales.
  • Fact-check claims against reliable sources.
  • Assess compliance with content policies and style guides.
  • Evaluate search result relevance and give live feedback during sessions.

Skills

English proficiency
Attention to detail
Rubric-based evaluation
Fact-checking
Critical reasoning

Education

Degree in a field you can evaluate

Tools

AI evaluation platforms

Job description

Clera is seeking detail-oriented evaluators to rate and rank AI model responses. You will apply rubrics to assess accuracy, helpfulness, tone, and safety, labeling reasoning steps and fact-checking claims against sources.

Remote, project-based work with flexible hours, lasting from one week to several months. Candidates should have five years or less of relevant experience, strong English writing, and the ability to consistently apply guidelines across many items.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Associate (0-5 yrs)
Remote AI Evaluation Associate (0-5 yrs)

Clera • United States

Remote
USD 28,000 - 62,000
Remote Feedback & Alignment Specialist
Remote Feedback & Alignment Specialist

Clera • United States

Remote
USD 28,000 - 62,000
Competitive hourly pay
Fully remote work
Remote AI Quality Evaluator - CS Graduates
Remote AI Quality Evaluator - CS Graduates

prolificacademicltd • United States

Remote
USD 68,000 - 97,000
PayPal payments
Remote work
Remote AI Quality Evaluator
Remote AI Quality Evaluator

Alignerr • United States

Remote
USD 14,000 - 55,000
Fully remote
Flexible hours
Remote AI Quality Reviewer (English) – Flexible Hours
Remote AI Quality Reviewer (English) – Flexible Hours

Classifieds24.info • Detroit (MI)

Remote
USD 15,000 - 25,000
Remote work
Weekly payments
Up to $18/hour
Remote AI Evaluation & Testing Specialist
Remote AI Evaluation & Testing Specialist

Clera Labs, Inc. • United States

Remote
USD 41,000 - 83,000
Remote work
Remote AI Evaluator (CS Grad) - Model Reasoning, Up to $60/h
Remote AI Evaluator (CS Grad) - Model Reasoning, Up to $60/h

prolificacademicltd • United States

Remote
USD 68,000 - 97,000
Remote work
Flexible participation
Remote AI Quality Evaluator — Flexible, Weekly Pay
Remote AI Quality Evaluator — Flexible, Weekly Pay

BOZAMO • Leland (MS)

Hybrid
USD 40,000 - 65,000
Remote work
Clear guidelines and training
Performance feedback and opportunities
+1
Remote AI Quality Evaluator & Fact-Check Specialist
Remote AI Quality Evaluator & Fact-Check Specialist

Priceless Center LLC • United States

Hybrid
USD 45,000 - 67,000
Remote AI Search Quality Evaluator
Remote AI Search Quality Evaluator

Alignerr • United States

Remote
USD 21,000 - 30,000