Remote English Linguist for LLM Evaluation & Data

Mercor; Sydney; Remote; AUD 90,000 - 120,000; Full time

Benefits offered by this job

Fully remote

Flexible, asynchronous hours

Collaborative AI research environment

Cutting-edge projects

Job summary

Mercor is seeking experienced English Linguistic Experts to join an AI research project. You will evaluate how effectively a large language model performs in English-language tasks and curate high-quality English linguistic data to train and improve the model’s understanding and generation capabilities.

This fully remote role offers flexible, asynchronous hours and the chance to contribute to cutting-edge AI research in collaboration with a leading research lab.

Qualifications

• Proven experience editing, proofreading, and linguistically annotating English content.
• Ability to identify subtle grammatical errors and awkward phrasing.
• Experience evaluating LLM outputs or NLP datasets in English.
• Strong understanding of style, tone, and regional variations in English.
• Comfort with working in a distributed, remote environment.

Responsibilities

• Evaluate the quality and accuracy of LLM-generated English text across use cases (e.g., summarization, dialogue, grammar correction, rewriting, and reasoning).
• Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
• Annotate English text for grammatical, syntactic, semantic, and stylistic features.
• Identify model errors, inconsistencies, and language gaps, and provide feedback to improve LLM performance.
• Provide detailed linguistic feedback and analysis to guide ongoing model training efforts.

Skills

Native English fluency

Editing & proofreading

Linguistic annotation

NLP data work

Attention to detail

Independent remote work

Job description

Mercor is seeking experienced English Linguistic Experts to join an AI research project. You will evaluate how effectively a large language model performs in English-language tasks and curate high-quality English linguistic data to train and improve the model’s understanding and generation capabilities.

This fully remote role offers flexible, asynchronous hours and the chance to contribute to cutting-edge AI research in collaboration with a leading research lab.