Remote German Language AI Evaluation Specialist

Agency; Italia; Remote; EUR 48,000 - 80,000; Full time

Job summary

Agency is seeking German language specialists to shape the future of AI by testing grammar, syntax, morphology, semantics and pragmatics with large language models. You will engage the model on verb conjugation, case system, word order, declensions and stylistic variation, documenting failures to help harden model reasoning.

A master’s or PhD in German language, linguistics, or related field is ideal; publications, teaching experience, or hands‑on linguistic analysis signal fit.

Qualifications

• German language expertise across grammar, syntax, morphology and semantics.
• Ability to challenge models on language benchmarks and report failures clearly.
• Experience documenting prompt-framing problems and model errors.

Responsibilities

• Converse with the model on German language scenarios and verify outputs.
• Document failures and contribute to improved evaluation metrics.
• Suggest improvements to prompts and assessment methods.

Skills

German language

Linguistics knowledge

Metacognitive communication

Education

Master's degree in German language or linguistics

PhD in German language or linguistics

Job description

Agency is seeking German language specialists to shape the future of AI by testing grammar, syntax, morphology, semantics and pragmatics with large language models. You will engage the model on verb conjugation, case system, word order, declensions and stylistic variation, documenting failures to help harden model reasoning.

A master’s or PhD in German language, linguistics, or related field is ideal; publications, teaching experience, or hands‑on linguistic analysis signal fit.