Linguistics Expert

Alpheva; United States; Hybrid; USD 83,000 - 124,000; Part time

Job summary

Alpheva seeks senior linguistics evaluator for AI evaluation projects covering syntax, semantics, pragmatics, and linguistic evidence. You will review AI outputs, write reference answers, and explain corrections with traceable evidence.

This remote, project-based role offers hourly matched work and asynchronous collaboration with research teams. Responsibilities include evaluating advanced domain tasks, applying current standards, documenting edge cases, and maintaining professional judgment

Qualifications

• 7+ years of substantive experience in linguistics research or applied linguistics.
• Demonstrated senior-level judgment in syntax, semantics and pragmatics.
• Ability to write precise reference answers and justify corrections with evidence.

Responsibilities

• Evaluate AI-generated responses for factual accuracy and professional judgment.
• Apply current standards and risk considerations from linguistics and communication.
• Document errors, edge cases, and reasoning behind ideal responses.
• Collaborate asynchronously with Alpheva's research and evaluation teams.

Skills

Linguistics expertise

Senior judgment

Reference-answer writing

Job description

Bring senior linguistics expertise to AI evaluation projects focused on syntax, semantics, pragmatics, and linguistic evidence.

Review model responses and worked examples for lost meaning, inconsistent terminology, and register or context errors. Assess whether the reasoning meets professional standards for the stated task.

Write reference answers and scoring criteria grounded in syntax, semantics, pragmatics, and linguistic evidence. Explain consequential errors, evidence gaps, and the reasoning behind your corrections.

This is remote, project-based contract work. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.

Responsibilities

• Evaluate advanced domain tasks and AI-generated responses for factual accuracy and professional judgment.
• Apply current standards, methods, and risk considerations from languages & communication.
• Document errors, edge cases, and the reasoning behind an ideal response.
• Collaborate asynchronously with Alpheva's research and evaluation teams.

Required Qualifications

• 7+ years of substantive experience in linguistics research or applied linguistics.
• Demonstrated senior-level judgment in syntax, semantics, pragmatics, and linguistic evidence, with substantial responsibility for reviewing or delivering this work.
• Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.