Linguistic Quality Analyst for LLM Conversations

Crossing Hurdles; Österreich; Vor Ort; EUR 45.000 - 75.000; Vollzeit

Zusammenfassung

Crossing Hurdles in Austria seeks a linguistics-focused evaluator to review conversations between humans and large language models, ensuring accuracy and clarity.

You will assess model outputs against instruction guidelines, provide detailed written and verbal feedback, and document findings in organized reports. Strong writing and linguistics background are essential for providing clear insights.

Qualifikationen

• Native proficiency in U.S. English.
• Advanced academic background or extensive professional experience in linguistics or related fields.
• Demonstrated expertise in written communication with nuanced linguistic assessments.
• Strong skills as a writer and linguistic specialist with exceptional attention to language detail.
• Ability to provide clear written and verbal insights in English.
• Experience with guideline or rubric-based evaluation preferred.

Aufgaben

• Review and analyze conversations between humans and large language models for accuracy and clarity.
• Assess responses generated by LLMs against instruction-following guidelines.
• Provide detailed written and verbal feedback on model output quality.
• Identify errors in grammar, usage, and context to ensure linguistic precision.
• Deliver actionable feedback with attention to detail, focusing on accuracy.
• Document findings and recommendations in organized reports.
• Collaborate with project coordinators to clarify guidelines and address ambiguities.

Kenntnisse

English language expert

Linguistics background

Written communication

Attention to language detail

Ausbildung

Advanced degree in linguistics or related field

Jobbeschreibung

Crossing Hurdles in Austria seeks a linguistics-focused evaluator to review conversations between humans and large language models, ensuring accuracy and clarity.

You will assess model outputs against instruction guidelines, provide detailed written and verbal feedback, and document findings in organized reports. Strong writing and linguistics background are essential for providing clear insights.