AI Model Evaluator & Feedback Specialist (Remote)

YPAI; United States; Remote; USD 28,000 - 39,000; Full time

Job summary

YPAI is seeking evaluators to rate AI answers from home in the United States. You’ll compare responses to project criteria and provide concrete, brief reasons for each rating.

The job emphasizes careful reading, factual checks, and explicit flagging of unsafe content, with pay issued biweekly. Ideal candidates are detail-oriented, able to explain the reasoning behind judgments, and comfortable handling potentially offensive material as part of quality assurance.

Qualifications

• Strong reading comprehension in the language evaluated.
• Ability to explain rationale behind ratings, not just scores.
• 18 years or older.

Responsibilities

• Rate and compare AI answers against project criteria.
• Write a short, concrete reason for each rating.
• Check facts in an answer and rewrite weak ones when required.
• Explicitly flag unsafe or policy-violating output.

Skills

Reading comprehension

Analytical explanation

Attention to detail

Job description

YPAI is seeking evaluators to rate AI answers from home in the United States. You’ll compare responses to project criteria and provide concrete, brief reasons for each rating.

The job emphasizes careful reading, factual checks, and explicit flagging of unsafe content, with pay issued biweekly. Ideal candidates are detail-oriented, able to explain the reasoning behind judgments, and comfortable handling potentially offensive material as part of quality assurance.