English Linguistic Expert - Evaluator

Mercor; San Francisco (CA); Hybrid; GBP 46,000 - 56,000; Part time

Job summary

Mercor, a hub for elite creative and technical talent, is seeking an English Language and Literature Expert on a remote contract basis. You will evaluate and refine LLM-generated English text across use cases, ensuring high linguistic, stylistic, and cultural standards.

You will annotate and feedback on model performance, identify language gaps, and guide ongoing model training efforts, collaborating with distributed teams while maintaining independence in a remote environment.

Qualifications

• Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.
• Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
• Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
• Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
• Strong attention to detail, analytical judgment, and written communication skills.
• Ability to work independently in a distributed, remote environment.

Responsibilities

• Evaluate the quality and accuracy of LLM-generated English text across various use cases such as summarization, dialogue, grammar correction, rewriting, and reasoning.
• Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
• Annotate English text for grammatical, syntactic, semantic, and stylistic features to enhance model understanding.
• Identify model errors, inconsistencies, and language gaps, providing feedback to improve LLM performance.
• Provide detailed linguistic feedback and analysis to guide ongoing model training efforts.

Skills

English proficiency

Editing and proofreading

Linguistic annotation

NLP data work

Excellent grammar and style

Remote work capability

Job description

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: English Language and Literature Expert
Type: Contract
Compensation: $50/hour
Location: Remote

Role Responsibilities

• Evaluate the quality and accuracy of LLM-generated English text across various use cases such as summarization, dialogue, grammar correction, rewriting, and reasoning.
• Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
• Annotate English text for grammatical, syntactic, semantic, and stylistic features to enhance model understanding.
• Identify model errors, inconsistencies, and language gaps, providing feedback to improve LLM performance.
• Provide detailed linguistic feedback and analysis to guide ongoing model training efforts.

Qualifications

Must-Have

• Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.
• Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
• Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
• Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
• Strong attention to detail, analytical judgment, and written communication skills.
• Ability to work independently in a distributed, remote environment.

Preferred

• Interest in AI and LLM-driven language technologies.

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: [e-mail]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.