Remote AI Evaluation: English Creative Data Annotator II

AuraOne Human Data

United States

Teletrabalho

USD 25 000 - 39 000

Tempo integral

Há 2 dias
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

AuraOne Human Data seeks an English Creative Data Annotation Generalist II (AI Evaluation) to remotely review and annotate AI outputs. You will compare responses, apply a detailed rubric, and provide structured feedback for retraining.

The role is contractor-based with US-eligible remote work and an hourly pay model. Responsibilities include labeling edge cases, documenting failure modes, and ensuring consistent reasoning across batches.

Qualificações

  • Experience evaluating or annotating data for AI evaluation tasks.
  • Ability to apply long-form rubrics consistently across large batches.
  • Clear written reasoning that identifies issues and rubric clauses.
  • Strong attention to detail and the ability to flag problem prompts.
  • Reliable async availability for at least 10 hours per week.

Responsabilidades

  • Evaluate model outputs against a versioned rubric and assign severity tags for English Creative Data Annotation Generalist II (AI Evaluation) assignments.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples weekly.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Conhecimentos

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Copy Writing

Descrição da oferta de emprego

AuraOne Human Data seeks an English Creative Data Annotation Generalist II (AI Evaluation) to remotely review and annotate AI outputs. You will compare responses, apply a detailed rubric, and provide structured feedback for retraining.

The role is contractor-based with US-eligible remote work and an hourly pay model. Responsibilities include labeling edge cases, documenting failure modes, and ensuring consistent reasoning across batches.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Remote AI Evaluation Annotator - English Creative Data
Remote AI Evaluation Annotator - English Creative Data

AuraOne Human Data • EUA

Teletrabalho
USD 34 000 - 55 000
Remote AI Evaluation Annotator — English Creative Data
Remote AI Evaluation Annotator — English Creative Data

AuraOne Human Data • EUA

Teletrabalho
USD 21 000 - 34 000
Remote AI Data Annotation Evaluator & Quality Reviewer
Remote AI Data Annotation Evaluator & Quality Reviewer

AuraOne, Inc. • EUA

Teletrabalho
USD 28 000 - 41 000
Remote AI Quality Evaluator - English Evaluation
Remote AI Quality Evaluator - English Evaluation

AuraOne, Inc. • EUA

Teletrabalho
USD 34 000 - 55 000
Remote AI Safety Data Annotator & Evaluator
Remote AI Safety Data Annotator & Evaluator

AuraOne Human Data • EUA

Teletrabalho
USD 34 000 - 55 000
Remote AI Data Evaluator, English & Assamese
Remote AI Data Evaluator, English & Assamese

Auraone • EUA

Teletrabalho
USD 21 000 - 28 000
Remote work
Contractor flexibility
English Creative Data Annotation Generalist II (AI Evaluation)
English Creative Data Annotation Generalist II (AI Evaluation)

AuraOne Human Data • EUA

Teletrabalho
USD 25 000 - 39 000
Remote AI Evaluation & Rubric Annotation Specialist
Remote AI Evaluation & Rubric Annotation Specialist

AuraOne Human Data • EUA

Teletrabalho
USD 28 000 - 48 000
Remote Video Annotation Evaluator — AI Data Labeling
Remote Video Annotation Evaluator — AI Data Labeling

AuraOne Human Data • EUA

Teletrabalho
USD 21 000 - 34 000
Remote AI Writing Data Review Specialist
Remote AI Writing Data Review Specialist

AuraOne Human Data • EUA

Teletrabalho
USD 28 000 - 41 000