Remote Social Content Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Benefits offered by this job

Remote work

Hourly pay after interview

Job summary

AuraOne is seeking a Social Content Production Reviewer to join a remote, contractor-based program in the US. You will evaluate model outputs against a versioned rubric, label issues, and provide structured feedback for retraining.

Expect strong attention to detail and clear written reasoning for rubric application. Responsibilities include comparing responses, tagging unsafe content, and calibrating scores weekly to maintain high quality.

Qualifications

• Prior evaluation, annotation, or human-rater experience on social content evaluation.
• Ability to apply multi-page rubrics consistently.
• Clear written reasoning naming issues and rubric clauses.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate social content evaluation model outputs against a rubric and assign severity tags.
• Compare paired responses and select the stronger one with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route for rubric updates.
• Calibrate reviewer quality against gold-standard examples weekly.

Skills

Evaluation experience

Annotation

Inter-rater calibration

Content moderation

Linguistics background

Job description

AuraOne is seeking a Social Content Production Reviewer to join a remote, contractor-based program in the US. You will evaluate model outputs against a versioned rubric, label issues, and provide structured feedback for retraining.

Expect strong attention to detail and clear written reasoning for rubric application. Responsibilities include comparing responses, tagging unsafe content, and calibrating scores weekly to maintain high quality.