Dutch AI Quality Evaluator – Personalization (Remote)

AuraOne Human Data

United States

Remote

USD 25,000 - 30,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne Human Data is seeking a remote Dutch AI Quality Analyst for Personalization Evaluation. You will review model outputs, apply rubrics, and label issues such as hallucinations or unsafe content, providing structured feedback for retraining.

The role requires clear written reasoning, attention to detail, and reliable async availability of at least 10 hours per week. This is a contractor, remote-US eligible position with compensation $20 per hour.

Qualifications

  • Experience with evaluation or annotation of AI Dutch content.
  • Ability to apply rubrics consistently across long batches.
  • Excellent written reasoning that names the issue and rubric clause.
  • Attention to detail and ability to flag when a prompt is the problem.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Evaluate AI quality analyst Dutch evaluation model outputs against a versioned rubric and assign severity tags for assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
AI Quality Analyst Dutch evaluation
Domain-Specific Languages

Job description

AuraOne Human Data is seeking a remote Dutch AI Quality Analyst for Personalization Evaluation. You will review model outputs, apply rubrics, and label issues such as hallucinations or unsafe content, providing structured feedback for retraining.

The role requires clear written reasoning, attention to detail, and reliable async availability of at least 10 hours per week. This is a contractor, remote-US eligible position with compensation $20 per hour.

Get your free, confidential resume review.

or drag and drop your file here.