English Linguistic Expert - Evaluator

mercor; San Francisco (CA); Hybrid; AUD 83,000 - 114,000; Part time

Job summary

Mercor is seeking an English Language and Literature Expert for a remote contract role. You will evaluate the quality of LLM-generated English text across use cases such as summarization, dialogue, and rewriting.

You will edit, refine, or rewrite content to meet high linguistic standards, annotate text for grammar and style, and provide detailed feedback to improve model performance. The position offers $50/hour and requires native or near-native English with strong attention to detail and

Qualifications

• Native or near-native fluency in English with excellent grammar and stylistics.
• Professional experience in editing, proofreading, writing, linguistic annotation, or NLP data work in English.
• Strong understanding of nuances, tone, and context-appropriate English usage.
• Ability to identify subtle grammatical errors and awkward phrasing.
• Strong attention to detail and independent work in a distributed remote environment.

Responsibilities

• Evaluate the quality and accuracy of LLM-generated English text across multiple use cases (summarization, dialogue, grammar correction, rewriting, reasoning).
• Edit, refine, or rewrite English content to meet high linguistic and cultural standards.
• Annotate English text for grammatical, syntactic, semantic, and stylistic features to guide model training.

Skills

Fluent English

Editing and proofreading

Linguistic annotation

Language evaluation

Attention to detail

Remote work

Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: English Language and Literature Expert

Type: Contract

Compensation: $50/hour

Location: Remote

Role Responsibilities

• Evaluate the quality and accuracy of LLM-generated English text across various use cases such as summarization, dialogue, grammar correction, rewriting, and reasoning.
• Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
• Annotate English text for grammatical, syntactic, semantic, and stylistic features to enhance model understanding.
• Identify model errors, inconsistencies, and language gaps, providing feedback to improve LLM performance .
• Provide detailed linguistic feedback and analysis to guide ongoing model training efforts .

Qualifications

Must-Have

• Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.
• Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
• Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
• Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
• Strong attention to detail, analytical judgment, and written communication skills.
• Ability to work independently in a distributed, remote environment .

Preferred

• Interest in AI and LLM-driven language technologies .