Remote Indonesian Evaluation & Annotation Specialist

AuraOne, Inc.; United States; A distancia; USD 34.000 - 49.000; Jornada completa

Descripción de la vacante

AuraOne, Inc. is seeking Indonesian Linguistic Experts to remotely review evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write structured feedback to help retrain models.

The role emphasizes clear reasoning, consistent rubric application, and documenting recurring failure modes. It is a contractor position with flexible hours and a requirement to be US-remote eligible; compensation is $30 per hour.

Formación

• Experience evaluating Indonesian content with rubric-based labeling.
• Ability to apply multi-page rubrics consistently.
• Clear written rationale referencing rubric clauses.
• Attention to detail and flagging prompt issues.
• Reliable (at least 10 hours per week) for async work.

Responsabilidades

• Evaluate Indonesian generalist evaluation outputs against a rubric and tag severity.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and route to program team for rubric updates.
• Maintain reviewer-quality scores by calibration with gold standard examples.
• Document recurring failure modes for retraining.

Conocimientos

Indonesian evaluation

Rubric annotation

Severity tagging

Inter-rater calibration

Generalist evaluation

Descripción del empleo

AuraOne, Inc. is seeking Indonesian Linguistic Experts to remotely review evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write structured feedback to help retrain models.

The role emphasizes clear reasoning, consistent rubric application, and documenting recurring failure modes. It is a contractor position with flexible hours and a requirement to be US-remote eligible; compensation is $30 per hour.