Remote AI Language Quality Analyst

Mercor; Sydney; Remote; AUD 60,000 - 100,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Job summary

Mercor is seeking experienced English Linguistic Experts to join a cutting-edge AI research project and curate high-quality English linguistic data for training large language models. The role focuses on evaluating LL M performance in English tasks and providing linguistic feedback to improve generation and understanding capabilities.

You will edit, refine, and annotate English content, identify errors, and guide ongoing model training.

Qualifications

• Native or near-native fluency in English with strong grammar and style.
• Experience editing, proofreading, or linguistic annotation in English.
• Experience in language evaluation or NLP data work is a plus.
• Sound understanding of linguistic nuances, tone, and context-appropriate usage.
• Attention to detail and ability to work independently in a distributed team.

Responsibilities

• Evaluate quality and accuracy of English text produced by LLMs across use cases.
• Edit, refine, or rewrite English content to meet high linguistic standards.
• Annotate English text for grammatical, syntactic, semantic, and stylistic features.
• Identify model errors and gaps; provide feedback to improve LLM performance.
• Provide detailed linguistic feedback to guide model training efforts.

Skills

English fluency

Editing & proofreading

Linguistic annotation

Language evaluation

NLP data work

Job description

Mercor is seeking experienced English Linguistic Experts to join a cutting-edge AI research project and curate high-quality English linguistic data for training large language models. The role focuses on evaluating LL M performance in English tasks and providing linguistic feedback to improve generation and understanding capabilities.

You will edit, refine, and annotate English content, identify errors, and guide ongoing model training.