Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
AfterQuery is hiring IT support specialists to author and grade troubleshooting scenarios used in frontier AI evaluations. You will work remotely and asynchronously, setting your own hours with a minimum of 10 hours per week.
Responsibilities include writing realistic IT support scenarios from first contact through resolution, drafting reference answers with diagnostic reasoning, grading model outputs for technical accuracy and user safety, and flagging guidance that could worsen problems.
IT support specialists to build the troubleshooting scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring IT support specialists as contractors to author and grade the troubleshooting scenarios those evaluations run on. What you'll actually do Author realistic IT support scenarios, from first contact through diagnosis and resolutionWrite reference answers with the diagnostic reasoning behind each stepGrade model output for technical accuracy and user safetyFlag advice that reads plausible but would make the problem worse Who this is for Specialists with at least 2 years in IT support, help desk, or system administrationPractitioners with hands on experience in enterprise environments such as Active Directory, Microsoft 365, or MDM toolsTroubleshooters with depth across hardware, software, and networking issuesClear writers who can document the reasoning behind a diagnostic decision Contract and pay $45 to $80/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start.Fully remote, fully async. No fixed hours.Minimum 10 hours per week, no maximum. Scale up or down week to week.No screen recording, no keystroke monitoring, no idle timers.Independent contractor. Ongoing project work rather than single task batches.
About AfterQuery AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates.