Remote Linguistics Evaluator for AI Language Judgments

AfterQuery; Netherlands; Remote; EUR 61,000 - 123,000; Full time

Benefits offered by this job

Weekly Stripe payments

Fully remote

Flexible hours

Job summary

AfterQuery is recruiting linguists as contractors to author and grade language analysis scenarios used in frontier AI labs' evaluations. You will work remotely with no fixed hours, minimum 10 hours per week, paid weekly via Stripe.

Your rate will be set by experience, and you can scale up or down week to week. The role requires an advanced degree in linguistics and at least two years of research, teaching, or applied work, with strong written English.

Qualifications

• Advanced degree in linguistics or related field.
• 2+ years of research, teaching, or applied linguistics work.
• Clear written English for documenting linguistic analysis.

Responsibilities

• Author linguistic scenarios testing syntax, semantics, and phonology.
• Write reference analyses with supporting argumentation behind judgments.
• Grade model output for analytical accuracy and data handling.
• Flag analyses that misparse data or mislabel phenomena.

Skills

Advanced linguistic reasoning

Strong written English

Independent contractor mindset

Education

Advanced degree in linguistics

PhD (preferred)

Tools

Remote collaboration tools

Job description

AfterQuery is recruiting linguists as contractors to author and grade language analysis scenarios used in frontier AI labs' evaluations. You will work remotely with no fixed hours, minimum 10 hours per week, paid weekly via Stripe.

Your rate will be set by experience, and you can scale up or down week to week. The role requires an advanced degree in linguistics and at least two years of research, teaching, or applied work, with strong written English.