Dutch Bilingual AI Evaluation Specialist (Remote)

AI Trainer Jobs; United States; Remote; USD 27,552,000 - 41,328,000; Part time

Benefits offered by this job

Remote work

US-eligible

Job summary

AuraOne is seeking a Dutch Bilingual Expert to remotely evaluate prompts and responses against its quality rubric. You will compare outputs, assign severity tags, and provide structured feedback for retraining.

As a contractor, you’ll help turn evaluations into auditable labels, rationales, and regression cases for AuraOne Human Data. This role emphasizes rigor, multi-page rubric application, and clear written reasoning.

Qualifications

• Prior evaluation, annotation, or human-rater experience on Dutch content.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause.
• Strong attention to detail and ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Dutch outputs against rubric and assign severity tags.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and route to program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples.

Skills

Dutch language proficiency

Attention to detail

Written reasoning

Async availability

Tools

Rubric-based annotation

Inter-rater calibration

Dutch bilingual evaluation

Job description

AuraOne is seeking a Dutch Bilingual Expert to remotely evaluate prompts and responses against its quality rubric. You will compare outputs, assign severity tags, and provide structured feedback for retraining.

As a contractor, you’ll help turn evaluations into auditable labels, rationales, and regression cases for AuraOne Human Data. This role emphasizes rigor, multi-page rubric application, and clear written reasoning.