Remote QA Reviewer & Adjudication Specialist

YPAI; United States; Remote; USD 39,000 - 55,000; Full time

Job summary

YPAI is seeking a detail-oriented reviewer to evaluate annotation and transcription work from home in the United States or other supported countries. You will assess samples against acceptance criteria, score items, and provide clear written feedback to ensure quality of data.

Responsibilities include resolving disagreements, calibrating annotators, and reporting recurring errors to improve guidelines. Applicants should be at least 18 years old and committed to precise, consistent judgment.

Qualifications

• Must have precision and willingness to reject work that fails the written criteria.
• Structured, consistent judgement and clear written feedback.
• 18 years or older.

Responsibilities

• Review sampled batches against the written acceptance criteria and score them using the project's rating criteria.
• Resolve disagreements between annotators and record your reason with clear feedback.
• Measure how often annotators agree and help calibrate them when they drift apart.
• Report recurring errors and guideline gaps to improve instructions.

Skills

Precision

Clear written feedback

Job description

YPAI is seeking a detail-oriented reviewer to evaluate annotation and transcription work from home in the United States or other supported countries. You will assess samples against acceptance criteria, score items, and provide clear written feedback to ensure quality of data.

Responsibilities include resolving disagreements, calibrating annotators, and reporting recurring errors to improve guidelines. Applicants should be at least 18 years old and committed to precise, consistent judgment.