German Language Expert for AI LLM Evaluation

Mercor; Wien; Hybrid; EUR 50.000 - 75.000; Vollzeit

Zusammenfassung

Mercor is seeking experienced German Linguistic Experts to join a cutting-edge AI research project in partnership with a leading research lab. This role centers on evaluating how effectively a large language model (LLM) performs in French-language tasks and on curating high-quality French linguistic data to train and improve the model’s understanding and generation capabilities.

You will work on evaluating LLM outputs, editing, annotating, and providing feedback to guide model improvements,

Qualifikationen

• Native or near-native fluency in German.
• Experience in literary editing or NLP-related linguistic annotation in German.
• Understanding of literary complexity, tone, and regional variations.
• Interest in AI/ translation research or LLM-driven language research.
• Impeccable attention to detail and ability to spot translation issues.

Aufgaben

• Evaluate quality and accuracy of LLM-generated German text across use cases (translation, summaries, dialogue, grammar).
• Edit, refine, or rewrite German content to meet linguistic standards.
• Annotate German texts for grammatical, syntactic, semantic, and stylistic features.
• Identify model errors and collaborate with researchers to improve LLM performance in German.
• Provide detailed literary and linguistic feedback to guide model training and evaluation.

Kenntnisse

German fluency

Editorial experience

NLP annotation

Remote teamwork

Jobbeschreibung

Mercor is seeking experienced German Linguistic Experts to join a cutting-edge AI research project in partnership with a leading research lab. This role centers on evaluating how effectively a large language model (LLM) performs in French-language tasks and on curating high-quality French linguistic data to train and improve the model’s understanding and generation capabilities.

You will work on evaluating LLM outputs, editing, annotating, and providing feedback to guide model improvements,