AI Language Model Evaluator — English (Remote)

Meridial

United States

Remote

USD 8,300 - 90,000

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aitrainergigs seeks English language specialists to challenge advanced language models and document failure modes from linguistic perspectives. You will converse with the model on grammar, syntax, semantics, and pragmatics, verifying accuracy and collecting reproducible error traces.

Ideal candidates hold a degree in English or linguistics, can show meta-cognitive communication, and will help improve prompts and evaluation metrics.

Qualifications

  • A degree in English language, linguistics, or a closely related field is ideal.
  • Peer‑reviewed publications, teaching experience, or hands‑on linguistic analysis signals fit.
  • Clear, metacognitive communication—“showing your work”—is essential.

Responsibilities

  • Converse with the model on language scenarios to test and elicit failures.
  • Verify factual accuracy and logical soundness of model outputs.
  • Capture reproducible error traces and document them clearly.
  • Suggest improvements to prompt engineering and evaluation metrics.

Skills

English grammar
Linguistics
Metacognitive communication

Education

Degree in English language or linguistics

Job description

Aitrainergigs seeks English language specialists to challenge advanced language models and document failure modes from linguistic perspectives. You will converse with the model on grammar, syntax, semantics, and pragmatics, verifying accuracy and collecting reproducible error traces.

Ideal candidates hold a degree in English or linguistics, can show meta-cognitive communication, and will help improve prompts and evaluation metrics.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Language Trainer: English Linguistics (Remote)
AI Language Trainer: English Linguistics (Remote)

Meridial • United States

Remote
USD 8,300 - 90,000
Remote English Language Specialist for AI Training Data
Remote English Language Specialist for AI Training Data

Meridial • United States

Remote
USD 8,300 - 90,000
AI Language Quality Specialist (Remote, Contract)
AI Language Quality Specialist (Remote, Contract)

Meridial • United States

Remote
USD 8,300 - 90,000
Remote English Language Specialist for AI Training
Remote English Language Specialist for AI Training

Meridial • United States

Remote
USD 8,300 - 90,000
Remote work
Remote Language Specialist for AI Linguistics
Remote Language Specialist for AI Linguistics

Meridial • United States

Remote
USD 8,300 - 90,000
Remote English Language Specialist (Contract)
Remote English Language Specialist (Contract)

Meridial • United States

Remote
USD 8,300 - 90,000
Remote Freelance English Language Specialist for AI
Remote Freelance English Language Specialist for AI

Meridial • United States

Remote
USD 8,300 - 90,000
French Language AI Evaluator (Remote)
French Language AI Evaluator (Remote)

Meridial • United States

Remote
USD 8,300 - 90,000
AI Language Specialist — Remote Linguistics Expert
AI Language Specialist — Remote Linguistics Expert

Parailabs • United States

Hybrid
USD 8,300 - 90,000
Remote Hmong Language Specialist for AI Evaluation
Remote Hmong Language Specialist for AI Evaluation

Meridial • United States

Remote
USD 8,300 - 90,000