Remote German Evaluation & Feedback Specialist

AuraOne; United States; Remote; USD 50,000 - 55,000; Full time

Job summary

AI Trainer Jobs in the United States is seeking a Bilingual Writer - German (Germany) to remotely review German prompts and responses, score them against AuraOne's rubric, and provide structured feedback for retraining.

You will compare paired outputs, label edge cases, and document rationales for the modeling team. Prior evaluation or annotation experience and clear written reasoning are valued; the role offers flexible remote work as an independent contractor.

Qualifications

• Experience evaluating German content and annotation tasks.
• Ability apply multi-page rubrics consistently.
• Strong written reasoning naming issues and rubric clauses.
• Reliable async availability 10 hours per week.

Responsibilities

• Evaluate model outputs against a rubric and assign severity.
• Compare paired responses and justify the stronger answer.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Flag ambiguous prompts and suggest rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.

Skills

German language

Linguistics background

Content moderation

Inter-rater calibration

Job description

AI Trainer Jobs in the United States is seeking a Bilingual Writer - German (Germany) to remotely review German prompts and responses, score them against AuraOne's rubric, and provide structured feedback for retraining.

You will compare paired outputs, label edge cases, and document rationales for the modeling team. Prior evaluation or annotation experience and clear written reasoning are valued; the role offers flexible remote work as an independent contractor.