Remote English Voice Data Reviewer & Rubric Auditor

AuraOne, Inc.; United States; Presencial; USD 34.000 - 55.000; A tiempo parcial

Descripción de la vacante

AuraOne, Inc. is seeking an independent contractor to perform English Voice Recording - Speech Data Collection evaluation tasks remotely. Review prompts and responses, label edge cases, and provide structured feedback to retrain models.

As a reviewer, compare paired outputs, apply the rubric, and document recurring failure modes. Reliable async availability for at least 10 hours per week is expected with high attention to detail.

Formación

• Experience in evaluation, annotation, or human-rater work on English voice recording evaluation tasks.
• Ability to apply multi-page rubrics consistently across large batches.
• Clear written reasoning that names the issue and rubric clause used.
• Attention to detail and ability to flag prompt-level problems.

Responsabilidades

• Evaluate English voice recording evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations and unsafe content with structured tags.
• Capture ambiguous prompts and escalate to rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.
• Document recurring failure modes for future training.

Conocimientos

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

English Voice Recording evaluation

Herramientas

None

Descripción del empleo

AuraOne, Inc. is seeking an independent contractor to perform English Voice Recording - Speech Data Collection evaluation tasks remotely. Review prompts and responses, label edge cases, and provide structured feedback to retrain models.

As a reviewer, compare paired outputs, apply the rubric, and document recurring failure modes. Reliable async availability for at least 10 hours per week is expected with high attention to detail.