Remote Plumber Expert for AI Scenario Author & Evaluator

AfterQuery; United States; Remote; USD 69,000 - 124,000; Part time

Benefits offered by this job

Weekly pay via Stripe

Job summary

AfterQuery is seeking licensed plumbers to author and grade realistic diagnosis and code compliance scenarios for frontier AI labs. This remote, async contractor role lets you work from home while applying your trade to evaluate model judgment on real plumbing tasks.

You will write reference answers with code reasoning, assess model outputs for safety and workmanship, and flag potentially dangerous advice. Must hold valid US license and have 2+ years of field experience.

Qualifications

• Journeyman or master plumber license required.
• At least two years of field experience beyond apprenticeship.
• Familiar with UPC or IPC plumbing codes.
• Clear written English for diagnostic reasoning.
• Able to commit at least 10 hours per week.

Responsibilities

• Author plumbing scenarios from symptom through diagnosis and repair.
• Provide reference answers with the diagnostic and code reasoning behind each step.
• Grade model output for code compliance, safety, and workmanship.
• Flag advice that reads plausible but would flood a basement or contaminate a water line.

Skills

2+ years field experience

Plumbing codes knowledge (UPC/IPC)

Clear written English

Commitment 10+ hours per week

Education

Journeyman/Master Plumber License

Job description

AfterQuery is seeking licensed plumbers to author and grade realistic diagnosis and code compliance scenarios for frontier AI labs. This remote, async contractor role lets you work from home while applying your trade to evaluate model judgment on real plumbing tasks.

You will write reference answers with code reasoning, assess model outputs for safety and workmanship, and flag potentially dangerous advice. Must hold valid US license and have 2+ years of field experience.