AI Evaluation Project Manager — Remote Contractor

AfterQuery

United States

Remote

USD 110,000 - 172,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AfterQuery is hiring project managers as contractors to author and grade the planning and delivery scenarios used to test frontier AI model judgment. You will author scenarios from kickoff through delivery and retrospectives, writing reference answers with the planning and prioritization behind each decision.

You will grade model output for realism, completeness, and stakeholder awareness, and flag plans that read polished but would fail in real delivery.

Qualifications

  • 2+ years of professional project management experience with named scope, budget, or stakeholders
  • Experience running full project lifecycles from kickoff through delivery
  • Depth in planning, risk management, and stakeholder communication
  • Clear written English for documenting project decisions and tradeoffs
  • Able to commit at least 10 hours per week

Responsibilities

  • Author realistic project scenarios from kickoff through delivery and retrospectives
  • Write reference answers with the planning and prioritization reasoning behind each decision
  • Grade model output for realism, completeness, and stakeholder awareness
  • Flag plans that read polished but would fail in real delivery

Skills

Project management
Written communication
Stakeholder management

Job description

AfterQuery is hiring project managers as contractors to author and grade the planning and delivery scenarios used to test frontier AI model judgment. You will author scenarios from kickoff through delivery and retrospectives, writing reference answers with the planning and prioritization behind each decision.

You will grade model output for realism, completeness, and stakeholder awareness, and flag plans that read polished but would fail in real delivery.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Project Manager Expert
Project Manager Expert

AfterQuery • United States

Remote
USD 110,000 - 172,000
Remote Contract Architect for AI Design Evaluation
Remote Contract Architect for AI Design Evaluation

AfterQuery • United States

Remote
USD 138,000 - 172,000
Remote Product Manager — AI Judgment Scenarios (Contractor)
Remote Product Manager — AI Judgment Scenarios (Contractor)

AfterQuery • United States

Remote
USD 83,000 - 152,000
Remote Aerospace Scenario Designer & Evaluator
Remote Aerospace Scenario Designer & Evaluator

AfterQuery • United States

Remote
USD 138,000 - 179,000
Remote work
Weekly Stripe payments
Flexible hours
Remote PE Engineer Contractor: AI Evaluation Scenarios
Remote PE Engineer Contractor: AI Evaluation Scenarios

AfterQuery • United States

Remote
USD 145,000 - 262,000
Fully remote
Weekly pay via Stripe
Flexible weekly hours
+1
Senior Internal Auditor & AI Evaluation Specialist — Remote
Senior Internal Auditor & AI Evaluation Specialist — Remote

AfterQuery Experts • Charlotte (NC)

Remote
USD 91,000 - 129,000
Fully remote
Asynchronous schedule
Contract engagement (no sponsorship)
+1
Remote Contract UI/UX Designer for AI Evaluation Scenarios
Remote Contract UI/UX Designer for AI Evaluation Scenarios

AfterQuery • United States

Remote
USD 83,000 - 165,000
Remote Contract Strategist for AI Evaluation
Remote Contract Strategist for AI Evaluation

AfterQuery Experts • Washington

Remote
USD 103,000 - 158,000
Competitive pay
Fully remote
Flexible schedule
Science Teacher Expert for AI Evaluation - Remote
Science Teacher Expert for AI Evaluation - Remote

AfterQuery • United States

Remote
USD 62,000 - 103,000
Remote work
Weekly pay via Stripe
Flexible hours
+1
Product Manager Expert
Product Manager Expert

AfterQuery • United States

Remote
USD 83,000 - 152,000