Remote AI Product Manager: Build & Grade Model Judgments

AfterQuery

Poland

Remote

PLN 331,000 - 607,000

Full time

17 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AfterQuery is hiring product managers as contractors to author and grade the product judgment scenarios those evaluations run on. We seek experts who draft realistic scenarios from ambiguous problems through shipped decisions, explaining prioritization and tradeoffs clearly.

You'll grade model outputs on specs, roadmaps, and strategy for judgment quality, and flag plans that polish without addressing hard tradeoffs or user needs. Remote, async, ongoing projects with weekly Stripe payments.

Qualifications

  • Minimum 2 years as a product manager owning a live product or feature.
  • Shipped work you can point to, specs, launches, and the outcomes behind them.
  • Fluency with product tools and rituals, roadmaps, PRDs, analytics, and experiments.
  • Clear written English for documenting product reasoning.
  • Able to commit at least 10 hours per week.

Responsibilities

  • Author realistic product scenarios from ambiguous problem through shipped decision.
  • Write reference answers with the prioritization and tradeoff reasoning made explicit.
  • Grade model output on specs, roadmaps, and strategy for judgment quality.
  • Flag plans that read polished but dodge the hard tradeoff or ignore the user.

Skills

PM experience
Shipped work
Product tools
Written English
Time commitment

Job description

AfterQuery is hiring product managers as contractors to author and grade the product judgment scenarios those evaluations run on. We seek experts who draft realistic scenarios from ambiguous problems through shipped decisions, explaining prioritization and tradeoffs clearly.

You'll grade model outputs on specs, roadmaps, and strategy for judgment quality, and flag plans that polish without addressing hard tradeoffs or user needs. Remote, async, ongoing projects with weekly Stripe payments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product Manager Expert
Product Manager Expert

AfterQuery • Poland

Remote
PLN 331,000 - 607,000
Project Manager Expert
Project Manager Expert

AfterQuery • Poland

Remote
PLN 441,000 - 689,000
100% remote
Fully async
Weekly payments via Stripe
Remote Product Analytics & Experimentation Pro (Async)
Remote Product Analytics & Experimentation Pro (Async)

AfterQuery • Poland

Remote
PLN 55,000 - 109,000
Weekly Stripe payments
Flexible hours
Product Analytics and Experimentation Expert
Product Analytics and Experimentation Expert

AfterQuery • Poland

Remote
PLN 55,000 - 109,000
Weekly Stripe payments
Flexible hours
Remote Technical Writer: AI Evaluation & API Docs
Remote Technical Writer: AI Evaluation & API Docs

AfterQuery • Poland

Remote
PLN 83,000 - 138,000
Fully remote
Asynchronous work
Competitive hourly pay
Remote Full-Stack Dev for AI Task Design & Review
Remote Full-Stack Dev for AI Task Design & Review

Anyone AI Inc. • Polska

Remote
PLN 165,000 - 331,000
Remote AI Response Evaluator
Remote AI Response Evaluator

Anyone AI Inc. • Polska

Hybrid
PLN 37,000 - 64,000
Remote work
Senior Product Manager - AI EdTech, Remote & Flexible
Senior Product Manager - AI EdTech, Remote & Flexible

constructortech • Poland

Hybrid
PLN 180,000 - 260,000
Newborn bonus (€500 per child)
English classes (iTalki)
Patent remuneration
+3
Education Expert
Education Expert

AfterQuery • Poland

Remote
PLN 193,000 - 386,000
Paid weekly via Stripe
Fully remote
Flexible weekly hours
Remote Full-Stack AI Trainer & Task Designer
Remote Full-Stack AI Trainer & Task Designer

Anyone AI • Poland

Remote
PLN 83,000 - 152,000
Top locations