Remote AI Evaluation Specialist (German/English)

Rex.zone; United States; Remote; USD 41,000 - 69,000; Full time

Job summary

Rex.zone is hiring Germany-based English/German AI Generalist Trainers to support RLHF and large language model evaluation by assessing, ranking, and validating model outputs to improve training data quality and drive model performance.

As a fully remote, full-time role based in Germany, you will evaluate outputs in English and German, write concise rationales, and help ensure policy compliance and safety labeling.

Qualifications

• Based in Germany and able to work remotely on a full-time schedule.
• Fluent in German and English (reading, writing, and nuance in both languages).
• Strong analytical reasoning and attention to detail; consistent guideline compliance.
• Comfortable working with structured workflows, task queues, and quality targets.
• Able to handle sensitive or safety-related content in line with labeling policies.

Responsibilities

• Evaluate and rank model outputs in English and German using rubrics.
• Perform RLHF-style preference rankings and prompt evaluation.
• QA evaluate to ensure training data quality and guideline adherence.
• Write concise, evidence-based rationales for evaluation decisions.
• Validate outputs for completeness, safety labeling, and policy compliance.
• Flag ambiguous prompts and gaps; propose clarifications.
• Track errors and failure patterns affecting performance.

Skills

German language

English language

Analytical reasoning

Attention to detail

Job description

Rex.zone is hiring Germany-based English/German AI Generalist Trainers to support RLHF and large language model evaluation by assessing, ranking, and validating model outputs to improve training data quality and drive model performance.

As a fully remote, full-time role based in Germany, you will evaluate outputs in English and German, write concise rationales, and help ensure policy compliance and safety labeling.