Plumber Expert

AfterQuery; United States; Remote; USD 69,000 - 124,000; Part time

Benefits offered by this job

Weekly pay via Stripe

Job summary

AfterQuery is seeking licensed plumbers to author and grade realistic diagnosis and code compliance scenarios for frontier AI labs. This remote, async contractor role lets you work from home while applying your trade to evaluate model judgment on real plumbing tasks.

You will write reference answers with code reasoning, assess model outputs for safety and workmanship, and flag potentially dangerous advice. Must hold valid US license and have 2+ years of field experience.

Qualifications

• Journeyman or master plumber license required.
• At least two years of field experience beyond apprenticeship.
• Familiar with UPC or IPC plumbing codes.
• Clear written English for diagnostic reasoning.
• Able to commit at least 10 hours per week.

Responsibilities

• Author plumbing scenarios from symptom through diagnosis and repair.
• Provide reference answers with the diagnostic and code reasoning behind each step.
• Grade model output for code compliance, safety, and workmanship.
• Flag advice that reads plausible but would flood a basement or contaminate a water line.

Skills

2+ years field experience

Plumbing codes knowledge (UPC/IPC)

Clear written English

Commitment 10+ hours per week

Education

Journeyman/Master Plumber License

Job description

Licensed plumbers to build the diagnosis and code compliance scenarios frontier AI labs use to test model judgment on real trade work. Remote, async, paid weekly. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring licensed plumbers as contractors to author and grade the diagnosis and code compliance scenarios those evaluations run on. This is knowledge work built on your trade, done entirely from home.

Author realistic plumbing scenarios from symptom through diagnosis and repair, the kind you actually run on a service call. Write reference answers with the diagnostic and code reasoning behind each step, why that venting, why that slope, which code section. Grade model output for code compliance, safety, and workmanship. Flag advice that reads plausible but would flood a basement or contaminate a water line, the misses only a working plumber would catch.

Who this is for

Journeyman and master plumbers with an active US license and at least two years of field work beyond apprenticeship. Residential service, commercial, and new construction plumbers, all specialties welcome. Tradespeople who can explain the why behind the fix, not just the fix. People comfortable writing clearly, this work is typed, not soldered.

Contract and pay

$50 to $90/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start. Fully remote, fully async. No fixed hours, it fits around jobs. Minimum 10 hours per week, no maximum. Scale up or down week to week. No screen recording, no keystroke monitoring, no idle timers. Independent contractor. Ongoing project work rather than single task batches.

How our hiring process works

About five minutes. Resume plus a few structured questions. Resume review. Every application gets read against a published rubric and gets a decision. Written assessment. You may be asked to take a written assessment for further placement. Onboarding. Sign the contractor agreement, connect Stripe, and get platform access. Project match. You're matched to live work in your specialty, usually within a week of onboarding.

About AfterQuery

AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates.

Responsibilities

• Author realistic plumbing scenarios from symptom through diagnosis and repair
• Write reference answers with the diagnostic and code reasoning behind each step
• Grade model output for code compliance, safety, and workmanship
• Flag advice that reads plausible but would flood a basement or poison a water line

Required Qualifications

• Journeyman or master plumber license in a US state or jurisdiction
• 2+ years of field experience beyond apprenticeship
• Working command of plumbing codes such as UPC or IPC
• Clear written English for documenting diagnostic reasoning
• Able to commit at least 10 hours per week

Preferred Qualifications

• Master plumber or plumbing contractor license
• Commercial, medical gas, or backflow certification depth
• Estimating, inspection, or apprentice training experience

Why apply

• Paid for your trade knowledge, no tools, no travel, no job site
• Set your own hours and scale up or down week to week, it fits around jobs
• Weekly pay via Stripe at a rate set from your experienceYour judgment shapes how the next generation of AI handles the trades