Swedish Language Evaluator & Rubric Reviewer (Remote)

AuraOne; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AuraOne is seeking a Swedish Language Expert (US/Canada Based) for remote evaluation of prompts and responses under AuraOne's quality rubric. You will review paired outputs, label edge cases, and write structured feedback for retraining the model.

The role requires prior evaluation or annotation experience in Swedish language content, strong written reasoning, and the ability to work asynchronously at least 10 hours per week. Compensation is hourly and determined after interview.

Qualifications

• Prior evaluation, annotation, or human-rater experience on Swedish language evaluation.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and rubric clause.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Swedish language evaluation model outputs against a versioned rubric and assign severity tags for Swedish Language Expert (US/Canada Based) assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Swedish language evaluation

Linguistics background

Content moderation

Attention to detail

Clear written reasoning

Async availability

Job description

AuraOne is seeking a Swedish Language Expert (US/Canada Based) for remote evaluation of prompts and responses under AuraOne's quality rubric. You will review paired outputs, label edge cases, and write structured feedback for retraining the model.

The role requires prior evaluation or annotation experience in Swedish language content, strong written reasoning, and the ability to work asynchronously at least 10 hours per week. Compensation is hourly and determined after interview.