Remote Linguistics Evaluation Specialist (Contract)

AfterQuery

United States

Remote

USD 69,000 - 138,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Weekly pay via Stripe
Fully remote
Flexible hours

Job summary

AfterQuery is seeking linguists to author and grade language analysis scenarios for frontier AI evaluations. This is a remote, contractor role with ongoing project work and no fixed hours.

We value advanced linguistics and research experience, strong written English, and the ability to work 10+ hours per week. Compensation is hourly and paid weekly via Stripe, with rates set by experience. Async work with emphasis on rigor and clear argumentation.

Qualifications

  • Advanced degree in linguistics or closely related field.
  • 2+ years of research, teaching, or applied linguistics work.
  • Depth in a subfield such as syntax, semantics, phonology, or sociolinguistics.
  • Clear written English for documenting linguistic analysis.
  • Able to commit at least 10 hours per week.

Responsibilities

  • Author linguistic scenarios that test analysis across syntax, semantics, and phonology
  • Write reference analyses with the argumentation behind each judgment
  • Grade model output for analytical accuracy and data handling
  • Flag analyses that read plausible but misparse the data or mislabel the phenomenon

Skills

2+ years of research, teaching, or 
ap
Depth in a subfield (syntax, semantics
Clear written English
Commit at least 10 hours per week

Education

Advanced degree in linguistics or closely related field

Job description

AfterQuery is seeking linguists to author and grade language analysis scenarios for frontier AI evaluations. This is a remote, contractor role with ongoing project work and no fixed hours.

We value advanced linguistics and research experience, strong written English, and the ability to work 10+ hours per week. Compensation is hourly and paid weekly via Stripe, with rates set by experience. Async work with emphasis on rigor and clear argumentation.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Linguistics Evaluator for AI Quality & Feedback
Remote Linguistics Evaluator for AI Quality & Feedback

Remotebridge • United States

Remote
USD 55,000 - 83,000
Remote Language Specialist for AI Linguistics
Remote Language Specialist for AI Linguistics

Meridial • United States

Remote
USD 8,300 - 90,000
Remote Linguistic QA Reviewer (Contract)
Remote Linguistic QA Reviewer (Contract)

Auraone • United States

Remote
USD 110,000 - 131,000
Remote Literary Scholar for AI Evaluation & Scenarios
Remote Literary Scholar for AI Evaluation & Scenarios

AfterQuery • United States

Remote
USD 69,000 - 138,000
Linguistics Expert
Linguistics Expert

AfterQuery • United States

Remote
USD 69,000 - 138,000
Weekly pay via Stripe
Fully remote
Flexible hours
Remote Evaluation Reviewer — English Linguistic Specialist
Remote Evaluation Reviewer — English Linguistic Specialist

AuraOne Human Data • United States

Remote
USD 62,000 - 83,000
Remote English Language Specialist (Contract)
Remote English Language Specialist (Contract)

Meridial • United States

Remote
USD 8,300 - 90,000
Remote Linguistics Expert for AI Feedback - Part-Time
Remote Linguistics Expert for AI Feedback - Part-Time

Handshake AI • United States

Remote
USD 34,000 - 83,000
Remote SLP Expert Contractor for AI Evaluation
Remote SLP Expert Contractor for AI Evaluation

AfterQuery • United States

Remote
USD 96,000 - 145,000
Remote work
Weekly Stripe payments
Linguistics Expert
Linguistics Expert

Alpheva • United States

Remote
USD 276,000 - 344,000