Remote Swiss German Evaluation & Annotation Specialist

AuraOne; United States; Remote; USD 34,000 - 69,000; Full time

Job summary

AuraOne is seeking a Swiss German Transcription Expert for a remote evaluation track. You will review German generalist outputs, compare paired responses, and label edge cases against AuraOne's quality rubric.

As a contractor, you will provide structured feedback and rationales, helping calibrate reviewer-quality scores and guide improvements. This remote role is US-eligible and requires a minimum weekly commitment.

Qualifications

• Experience evaluating German generalist evaluation or related content.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning linking issues to rubric clauses.

Responsibilities

• Evaluate German generalist evaluation model outputs against a rubric.
• Compare paired responses and provide a rationale for the preferred answer.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Document recurring failure modes for rubric updates.
• Maintain reviewer-quality scores through calibration with gold-standard examples.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

German generalist evaluation

Job description

AuraOne is seeking a Swiss German Transcription Expert for a remote evaluation track. You will review German generalist outputs, compare paired responses, and label edge cases against AuraOne's quality rubric.

As a contractor, you will provide structured feedback and rationales, helping calibrate reviewer-quality scores and guide improvements. This remote role is US-eligible and requires a minimum weekly commitment.