Remote Typography QA Reviewer - Contractor

AuraOne, Inc.; United States; Remote; USD 28,000 - 55,000; Part time

Job summary

AuraOne, Inc. seeks a remote Typography Production Reviewer to evaluate model outputs against a rubric and provide structured feedback. You will compare paired responses, label edge cases, and document failures to help retrain the system.

This is a remote contractor role with US eligibility and requires reliable availability of at least 10 hours per week. Responsibilities include tagging severity, collecting rationales, and contributing to rubric updates.

Qualifications

• Experience in evaluation, annotation, or human-rater work on typography production evaluation or related content.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger one with a rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and flag for rubric updates.
• Calibrate reviewer-quality scores against gold-standard examples weekly.
• Document recurring failure modes for model improvement.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Typography Production evaluation

Creative review

Production quality

Design critique

Typography

Job description

AuraOne, Inc. seeks a remote Typography Production Reviewer to evaluate model outputs against a rubric and provide structured feedback. You will compare paired responses, label edge cases, and document failures to help retrain the system.

This is a remote contractor role with US eligibility and requires reliable availability of at least 10 hours per week. Responsibilities include tagging severity, collecting rationales, and contributing to rubric updates.