Remote AI Safety Data Annotator & Evaluator

AuraOne Human Data

United States

Teletrabalho

USD 34 000 - 55 000

Tempo integral

Há 2 dias
Torna-te num dos primeiros candidatos

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

AuraOne, Inc. is seeking an AI Trainer - Data Annotation Specialist (Safety) for remote evaluation work. You will review prompts and model outputs, compare paired responses, and assign structured feedback to guide retraining.

This contractor role emphasizes careful evaluation, rubric alignment, and clear rationale across multilingual prompts. The position requires strong attention to detail, reliable weekly availability of at least 10 hours, and the ability to flag problematic prompts or outputs

Qualificações

  • Prior evaluation, annotation, or human-rater experience on AI trainer data annotation evaluation or adjacent content.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Responsabilidades

  • Evaluate AI trainer data annotation evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and pick the stronger answer with written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Conhecimentos

Attention to detail
Written reasoning
Async availability
Rubric-based annotation
Inter-rater calibration
Data annotation

Descrição da oferta de emprego

AuraOne, Inc. is seeking an AI Trainer - Data Annotation Specialist (Safety) for remote evaluation work. You will review prompts and model outputs, compare paired responses, and assign structured feedback to guide retraining.

This contractor role emphasizes careful evaluation, rubric alignment, and clear rationale across multilingual prompts. The position requires strong attention to detail, reliable weekly availability of at least 10 hours, and the ability to flag problematic prompts or outputs

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Remote AI Data Annotation Evaluator & Quality Reviewer
Remote AI Data Annotation Evaluator & Quality Reviewer

AuraOne, Inc. • EUA

Teletrabalho
USD 28 000 - 41 000
Remote AI Evaluation Annotator - English Creative Data
Remote AI Evaluation Annotator - English Creative Data

AuraOne Human Data • EUA

Teletrabalho
USD 34 000 - 55 000
AI Trainer - Data Annotation Specialist (Safety)
AI Trainer - Data Annotation Specialist (Safety)

AuraOne Human Data • EUA

Teletrabalho
USD 34 000 - 55 000
Remote Data Evaluator for Model Feedback & Rubrics
Remote Data Evaluator for Model Feedback & Rubrics

Auraone • EUA

Teletrabalho
USD 21 000 - 34 000
Remote AI Evaluation & Feedback Specialist
Remote AI Evaluation & Feedback Specialist

Auraone • EUA

Teletrabalho
USD 34 000 - 83 000
Remote work
Contractor engagement
US-eligible
Remote AI Evaluation Annotator — English Creative Data
Remote AI Evaluation Annotator — English Creative Data

AuraOne Human Data • EUA

Teletrabalho
USD 21 000 - 34 000
Remote AI Evaluation: English Creative Data Annotator II
Remote AI Evaluation: English Creative Data Annotator II

AuraOne Human Data • EUA

Teletrabalho
USD 25 000 - 39 000
Remote AI Trainer Evaluator, Life Sciences (Contract)
Remote AI Trainer Evaluator, Life Sciences (Contract)

AuraOne Human Data • EUA

Teletrabalho
USD 34 000 - 55 000
Remote AI Evaluation & Rubric Annotation Specialist
Remote AI Evaluation & Rubric Annotation Specialist

AuraOne Human Data • EUA

Teletrabalho
USD 28 000 - 48 000
AI Evaluation Data Analyst — Remotely Review & Calibrate
AI Evaluation Data Analyst — Remotely Review & Calibrate

Auraone • EUA

Teletrabalho
USD 97 000 - 138 000