Remote Norwegian Language Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 57,000 - 81,000; Full time

Job summary

AuraOne is seeking a Norwegian Language Expert for remote evaluation of prompts and responses against its quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining.

As a contractor, you will help turn evaluation outputs into auditable labels, rationales, and regression cases, and you will review frontier model outputs to judge benchmark failures and calibrate other evaluators.

Qualifications

• Prior evaluation or annotation experience on Norwegian language evaluation or related content.
• Comfort applying multi-page rubrics consistently.
• Clear written reasoning that names the issue and rubric clause being applied.
• Strong attention to detail and ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger one with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to program team for rubric updates.
• Calibrate reviewer-quality scores against gold-standard examples weekly.

Skills

Evaluation experience

Annotation

Rubrics

Attention to detail

Availability

Job description

AuraOne is seeking a Norwegian Language Expert for remote evaluation of prompts and responses against its quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining.

As a contractor, you will help turn evaluation outputs into auditable labels, rationales, and regression cases, and you will review frontier model outputs to judge benchmark failures and calibrate other evaluators.