Senior Linguistics & AI Evaluation Expert (Remote)

Alpheva; United States; Hybrid; USD 83,000 - 124,000; Part time

Job summary

Alpheva seeks senior linguistics evaluator for AI evaluation projects covering syntax, semantics, pragmatics, and linguistic evidence. You will review AI outputs, write reference answers, and explain corrections with traceable evidence.

This remote, project-based role offers hourly matched work and asynchronous collaboration with research teams. Responsibilities include evaluating advanced domain tasks, applying current standards, documenting edge cases, and maintaining professional judgment

Qualifications

• 7+ years of substantive experience in linguistics research or applied linguistics.
• Demonstrated senior-level judgment in syntax, semantics and pragmatics.
• Ability to write precise reference answers and justify corrections with evidence.

Responsibilities

• Evaluate AI-generated responses for factual accuracy and professional judgment.
• Apply current standards and risk considerations from linguistics and communication.
• Document errors, edge cases, and reasoning behind ideal responses.
• Collaborate asynchronously with Alpheva's research and evaluation teams.

Skills

Linguistics expertise

Senior judgment

Reference-answer writing

Job description

Alpheva seeks senior linguistics evaluator for AI evaluation projects covering syntax, semantics, pragmatics, and linguistic evidence. You will review AI outputs, write reference answers, and explain corrections with traceable evidence.

This remote, project-based role offers hourly matched work and asynchronous collaboration with research teams. Responsibilities include evaluating advanced domain tasks, applying current standards, documenting edge cases, and maintaining professional judgment