Remote AI Quality Evaluator & Fact-Check Specialist

Priceless Center LLC; United States; Hybrid; USD 45,000 - 67,000; Full time

Job summary

Priceless Center LLC in the United States is recruiting for a three-month remote AI evaluation project starting around October 13, 2026. We seek analytical, detail-oriented English-speaking evaluators for two tracks: Factuality Evaluation and Core Quality Evaluation.

You will review AI-generated responses, verify claims via credible sources, compare model outputs, and provide clear, evidence-based explanations following detailed guidelines.

Qualifications

• Based in the United States
• Fluent in English with strong reading and writing skills
• Ability to follow detailed instructions and multi-step workflows
• Experience in AI evaluation, data annotation, or QA is a plus

Responsibilities

• Review AI-generated responses across topics
• Identify verifiable claims and separate them for verification
• Research claims using credible online sources
• Determine whether claims are accurate, inaccurate, or unverifiable
• Compare outputs from multiple AI models to assess quality
• Evaluate accuracy, helpfulness, clarity, instruction-following and overall quality
• Provide clear, evidence-based explanations for evaluation decisions
• Follow detailed guidelines and maintain evaluation records

Skills

Analytical thinking

Attention to detail

Strong writing skills

Reading comprehension

Following instructions

Critical thinking

English proficiency

Research skills

Asking questions when unclear

Job description

Priceless Center LLC in the United States is recruiting for a three-month remote AI evaluation project starting around October 13, 2026. We seek analytical, detail-oriented English-speaking evaluators for two tracks: Factuality Evaluation and Core Quality Evaluation.

You will review AI-generated responses, verify claims via credible sources, compare model outputs, and provide clear, evidence-based explanations following detailed guidelines.