English Linguistic Expert - Evaluator

Mercor; New York (NY); A distancia; USD 60.000 - 90.000; Jornada completa

Descripción de la vacante

Mercor is seeking experienced English Linguistic Experts to join a cutting-edge AI research project in partnership with a leading research lab. This role centers on evaluating LLM performance in English-language tasks and on curating high-quality English linguistic data to train and improve the model’s understanding and generation capabilities.

You're a strong fit if you have native or near-native fluency in English, with excellent grammar, editing, and linguistic annotation skills, and

Formación

• Native or near-native fluency in English with excellent grammar, syntax, vocabulary, and stylistics.
• Experience editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
• Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
• Ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.

Responsabilidades

• Evaluate the quality and accuracy of LLM-generated English text across use cases (e.g., summarization, dialogue, grammar correction, rewriting, and reasoning).
• Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
• Annotate English text for grammatical, syntactic, semantic, and stylistic features.
• Identify model errors, inconsistencies, and language gaps, and provide feedback to improve LLM performance.
• Provide detailed linguistic feedback and analysis to guide ongoing model training efforts.

Conocimientos

English proficiency

Editing and proofreading

Linguistic annotation

NLP data work

Descripción del empleo

Mercor is seeking experienced English Linguistic Experts to join a cutting-edge AI research project in partnership with a leading research lab. This role centers on evaluating how effectively a large language model (LLM) performs in English-language tasks and on curating high-quality English linguistic data to train and improve the model’s understanding and generation capabilities.

Key Responsibilities:

• Evaluate the quality and accuracy of LLM-generated English text across various use cases (e.g., summarization, dialogue, grammar correction, rewriting, and reasoning).
• Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
• Annotate English text for grammatical, syntactic, semantic, and stylistic features.
• Identify model errors, inconsistencies, and language gaps, and provide feedback to improve LLM performance.
• Provide detailed linguistic feedback and analysis to guide ongoing model training efforts.

You're a strong fit if you have:

• Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.
• Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
• Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
• Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
• Interest in AI and LLM-driven language technologies is preferred but not required.
• Strong attention to detail, analytical judgment, and written communication skills.
• Ability to work independently in a distributed, remote environment.

Why Join

• Contribute to cutting-edge AI research in partnership with a leading research lab.
• Work on high-impact projects that directly support the development of advanced AI systems.
• Gain hands-on exposure to state-of-the-art AI research and development.
• Work fully remotely with flexible, asynchronous hours.
• Join a fast-moving project where your expertise and judgment can have a meaningful impact.