Bilingual German AI Evaluation Specialist

AuraOne, Inc.; Deutschland; Remote; EUR 31,000 - 37,000; Full time

Job summary

AuraOne, Inc. seeks a Bilingual German AI Evaluation Specialist to assess German outputs for fluency, accuracy and cultural fit. This remote contractor role requires native or near-native German and strong written English, with experience editing or evaluating German content.

You will compare paired responses, flag issues, and document native-speaker edits to support model improvement cycles. 10+ hours weekly availability is expected.

Qualifications

• Native or near-native German fluency with strong written-English ability for Bilingual German AI Evaluation Specialist work.
• Demonstrable experience editing, translating, or evaluating German content.
• Comfort applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.
• Reliable async availability for at least 10 hours per week.
• Prior model-evaluation, annotation, or human-rater experience is a plus.

Responsibilities

• Evaluate German model responses for fluency, accuracy, register, and cultural fit for Bilingual German AI Evaluation Specialist assignments.
• Compare paired german evaluation outputs and pick the stronger response with a written rationale.
• Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
• Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.
• Calibrate against the AuraOne German rubric in weekly reviewer-quality cycles.
• Surface ambiguous prompts back to the program team so the rubric can be sharpened.
• Maintain reviewer notes that document tricky idioms, regionalisms, and emerging usage.

Skills

Multilingual evaluation

Native-speaker review

Rubric application

LLM output evaluation

German evaluation

Tools

TMS tools

MQM error taxonomies

Job description

Bilingual German AI Evaluation Specialist is a remote German specialist track for evaluating german evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale that the modeling team can act on in the next training cycle.

Why this role matters

Multilingual model quality depends on reviewers who can read German the way a native speaker does. AuraOne uses these reviewers to set the bar for tone, formality, and cultural register before a model ever ships to German users.

Responsibilities

• Evaluate German model responses for fluency, accuracy, register, and cultural fit for Bilingual German AI Evaluation Specialist assignments.
• Compare paired german evaluation outputs and pick the stronger response with a written rationale.
• Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
• Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.
• Calibrate against the AuraOne German rubric in weekly reviewer-quality cycles.
• Surface ambiguous prompts back to the program team so the rubric can be sharpened.
• Maintain reviewer notes that document tricky idioms, regionalisms, and emerging usage.

Qualifications

• Native or near-native German fluency with strong written-English ability for Bilingual German AI Evaluation Specialist work.
• Demonstrable experience editing, translating, or evaluating German content.
• Comfort applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.
• Reliable async availability for at least 10 hours per week.
• Prior model-evaluation, annotation, or human-rater experience is a plus.

Example tasks

• Score a pair of German responses to a customer-support prompt and pick the better one with a 1-2 sentence rationale.
• Flag formality mismatches in german evaluation outputs (T/V usage, honorifics, regional register).
• Rewrite a model's German response so it reads naturally and tag the original error category.
• Audit a 50-row evaluation batch for rubric consistency and surface drift back to the program lead.

Nice to have

• Background in German linguistics, journalism, or translation studies.
• Experience with TMS tools, MQM error taxonomies, or other structured QA frameworks.
• Familiarity with LLM evaluation rubrics and inter-rater agreement workflows.

Skills

• Multilingual evaluation
• Native-speaker review
• Rubric application
• LLM output evaluation
• German evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$25–$30 / hr

Native or near-native German fluency with strong written-English ability for Bilingual German AI Evaluation Specialist work. Demonstrable experience editing, translating, or evaluating German content. Comfort applying multi-page rubrics consistently across long evaluation batches. Clear written reasoning that names the issue and the standard being applied. Reliable async availability for at least 10 hours per week. Prior model-evaluation, annotation, or human-rater experience is a plus.