Remote ESL Scenario Designer & Evaluator

AfterQuery

New Zealand

Remote

NZD 88,000 - 175,000

Full time

12 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

100% remote
Weekly Stripe payments
Flexible hours

Job summary

AfterQuery is seeking ESL teachers to author and grade language learning scenarios for frontier AI evaluations. This is a fully remote, async contractor role with weekly Stripe payments and no fixed hours.

Minimum 10 hours per week, with weekly scaling up or down as needed. Writers will author realistic ESL scenarios, provide reference answers with reasoning, and grade model outputs for accuracy and instructional appropriateness.

Qualifications

  • TEFL, TESOL, or CELTA certification, or a state ESL teaching license.
  • 2+ years of classroom or online ESL teaching.
  • Depth in lesson planning, error correction, and proficiency assessment.
  • Clear written English for documenting pedagogical reasoning.
  • Able to commit at least 10 hours per week.

Responsibilities

  • Author realistic ESL teaching scenarios across proficiency levels.
  • Write reference answers with the pedagogical reasoning behind each decision.
  • Grade model output for accuracy and level appropriateness.
  • Flag explanations that read correct but would confuse a language learner.

Skills

2+ years ESL teaching
Depth in lesson planning
Error correction
Proficiency assessment
Clear written English

Education

TEFL/TESOL/CELTA certification, or state ESL license

Job description

AfterQuery is seeking ESL teachers to author and grade language learning scenarios for frontier AI evaluations. This is a fully remote, async contractor role with weekly Stripe payments and no fixed hours.

Minimum 10 hours per week, with weekly scaling up or down as needed. Writers will author realistic ESL scenarios, provide reference answers with reasoning, and grade model outputs for accuracy and instructional appropriateness.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ESL Teacher Expert
ESL Teacher Expert

AfterQuery • New Zealand

Remote
NZD 88,000 - 175,000
100% remote
Weekly Stripe payments
Flexible hours
Remote Aerospace Scenario Designer & Evaluator
Remote Aerospace Scenario Designer & Evaluator

AfterQuery • New Zealand

Remote
NZD 138,000 - 179,000
Weekly Stripe payments
100% remote
Ongoing project work
+1
Remote Science Instruction Scenarios Contractor
Remote Science Instruction Scenarios Contractor

AfterQuery • New Zealand

Remote
NZD 62,000 - 103,000
Remote work
Flexible hours
Weekly payments via Stripe
+1
Remote AI Language Expert & Editor (Hourly)
Remote AI Language Expert & Editor (Hourly)

SME Careers • Hamilton

Remote
NZD 34,000 - 55,000
Science Teacher Expert
Science Teacher Expert

AfterQuery • New Zealand

Remote
NZD 62,000 - 103,000
Remote work
Flexible hours
Weekly payments via Stripe
+1
English Language Expert
English Language Expert

SME Careers • Hamilton

Remote
NZD 34,000 - 55,000
Senior AI Coding Evaluator (Remote, 10-20 hrs/wk)
Senior AI Coding Evaluator (Remote, 10-20 hrs/wk)

g2i • New Zealand

Remote
NZD 244,000 - 489,000
Employment Lawyer | Remote
Employment Lawyer | Remote

Crossing Hurdles • New Zealand

Remote
NZD 102,000 - 146,000
Remote AI Language Trainer — English Expert
Remote AI Language Trainer — English Expert

Meridial • New Zealand

Remote
NZD 8,265 - 89,544
Remote English Review Specialist for AI Projects
Remote English Review Specialist for AI Projects

Crewlia • New Zealand

Remote
NZD 36,000 - 52,000
Top locations