Remote Social Content Quality Auditor

AuraOne, Inc.; United States; Remote; USD 34.000 - 55.000; Teilzeit

Benefits dieser Stelle

Remote work

Zusammenfassung

AuraOne, Inc. is seeking a remote Social Content Quality Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining the model.

This contractor role requires careful attention to detail, clear written reasoning, and the ability to work asynchronously for at least 10 hours per week. Remote-US eligible; compensation discussed after interviews.

Qualifikationen

• Experience evaluating social content quality evaluation or related content.
• Ability to apply multi-page rubrics consistently across large batches.
• Clear written reasoning naming issues and applied rubric clauses.
• Strong attention to detail and ability to flag prompt problems.

Aufgaben

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route for rubric updates.
• Maintain reviewer-quality scores and calibrate against gold-standard examples.
• Document recurring failure modes for model improvement.

Kenntnisse

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Social Content Quality evaluation

Creative review

Production quality

Design critique

Social

Content

Jobbeschreibung

AuraOne, Inc. is seeking a remote Social Content Quality Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining the model.

This contractor role requires careful attention to detail, clear written reasoning, and the ability to work asynchronously for at least 10 hours per week. Remote-US eligible; compensation discussed after interviews.