A complete application in a minute
Tailored resume and cover letter, ready to send.
AfterQuery is seeking IT support specialists to author and grade realistic troubleshooting scenarios for frontier AI model evaluations. This fully remote, async contractor role covers first contact through diagnosis, and requires strong written English and experience in enterprise environments.
You will write reference answers with diagnostic reasoning, grade model outputs for accuracy and safety, and flag guidance that could worsen problems.
IT support specialists to build the troubleshooting scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring IT support specialists as contractors to author and grade the troubleshooting scenarios those evaluations run on. What you'll actually do Author realistic IT support scenarios, from first contact through diagnosis and resolutionWrite reference answers with the diagnostic reasoning behind each stepGrade model output for technical accuracy and user safetyFlag advice that reads plausible but would make the problem worse Who this is for Specialists with at least 2 years in IT support, help desk, or system administrationPractitioners with hands on experience in enterprise environments such as Active Directory, Microsoft 365, or MDM toolsTroubleshooters with depth across hardware, software, and networking issuesClear writers who can document the reasoning behind a diagnostic decision Contract and pay $45 to $80/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start.Fully remote, fully async. No fixed hours.Minimum 10 hours per week, no maximum. Scale up or down week to week.No screen recording, no keystroke monitoring, no idle timers.Independent contractor. Ongoing project work rather than single task batches.
AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates.