IT Support Specialist: Scenario Author & Evaluator (Remote)

AfterQuery

Singapore

Remote

SGD 80,000 - 142,000

Full time

32 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

100% remote
Weekly Stripe payments
Professional rates

Job summary

AfterQuery is seeking IT support specialists to author and grade realistic troubleshooting scenarios for frontier AI model evaluations. This fully remote, async contractor role covers first contact through diagnosis, and requires strong written English and experience in enterprise environments.

You will write reference answers with diagnostic reasoning, grade model outputs for accuracy and safety, and flag guidance that could worsen problems.

Qualifications

  • 2+ years of professional IT support, help desk, or system administration experience.
  • Hands on experience with enterprise environments such as Active Directory, Microsoft 365, or MDM tools.
  • Depth in troubleshooting across hardware, software, and networking issues.
  • Clear written English for documenting troubleshooting reasoning.
  • Able to commit at least 10 hours per week.

Responsibilities

  • Author realistic IT support scenarios from first contact through resolution.
  • Write reference answers with the diagnostic reasoning behind each step.
  • Grade model output for technical accuracy and user safety.
  • Flag advice that reads plausible but would make the problem worse.

Skills

IT support
Help desk
System administration

Tools

Active Directory
Microsoft 365
MDM tools

Job description

AfterQuery is seeking IT support specialists to author and grade realistic troubleshooting scenarios for frontier AI model evaluations. This fully remote, async contractor role covers first contact through diagnosis, and requires strong written English and experience in enterprise environments.

You will write reference answers with diagnostic reasoning, grade model outputs for accuracy and safety, and flag guidance that could worsen problems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

IT Support Specialist Expert
IT Support Specialist Expert

AfterQuery • Singapore

Remote
SGD 80,000 - 142,000
100% remote
Weekly Stripe payments
Professional rates
Remote English Teacher for AI Writing Scenarios (Contract)
Remote English Teacher for AI Writing Scenarios (Contract)

AfterQuery • Singapore

Remote
SGD 48,000 - 90,000
Fully remote
Weekly Stripe payments
Flexible hours
+1
Remote Senior Security Scenarios Architect
Remote Senior Security Scenarios Architect

AfterQuery • Singapore

Remote
SGD 160,000 - 240,000
Fully remote
Weekly pay via Stripe
Flexible hours
Remote Network Scenario Engineer
Remote Network Scenario Engineer

AfterQuery • Singapore

Remote
SGD 142,000 - 213,000
Remote work
Weekly Stripe payments
Flexible hours
+1
Information Security Analyst Expert
Information Security Analyst Expert

AfterQuery • Singapore

Remote
SGD 160,000 - 240,000
Fully remote
Weekly pay via Stripe
Flexible hours
Network Engineer Expert
Network Engineer Expert

AfterQuery • Singapore

Remote
SGD 142,000 - 213,000
Remote work
Weekly Stripe payments
Flexible hours
+1
Remote Content Writer for AI Evaluation (10-20 hrs/wk)
Remote Content Writer for AI Evaluation (10-20 hrs/wk)

AfterQuery • Singapore

Remote
SGD 55,000 - 110,000
Flexible hours
Remote work
English Teacher Expert
English Teacher Expert

AfterQuery • Singapore

Remote
SGD 48,000 - 90,000
Fully remote
Weekly Stripe payments
Flexible hours
+1
Remote MLS Expert: Lab Scenario Architect & Model Evaluator
Remote MLS Expert: Lab Scenario Architect & Model Evaluator

AfterQuery • Singapore

Remote
SGD 115,000 - 169,000
Science Teacher for AI Evaluation Labs — Remote Contract
Science Teacher for AI Evaluation Labs — Remote Contract

AfterQuery • Singapore

Remote
SGD 80,000 - 133,000
Weekly Stripe payments
Remote work
Flexible schedule