Remote Product Evaluator for AI Content & Specs

YO AI Labs; Oxford; Remote; GBP 55,000 - 111,000; Part time

Job summary

YO AI Labs seeks experienced Product Managers and Product Owners to contribute to a customer project evaluating and improving AI systems. The role centers on evaluating AI-generated specifications, content, and documentation, with no roadmap ownership or delivery management involved.

Ideal candidates have PM/PO experience, native English fluency, and strong ability to provide detailed, actionable feedback asynchronously in a remote environment.

Qualifications

• Experience creating and reviewing PRDs, specifications, acceptance criteria, release notes, or decision documents.
• Ability to evaluate content for technical stakeholders, executives, and end users.
• Native-level English fluency and excellent written communication skills.

Responsibilities

• Evaluate and compare AI-generated specifications, release notes, user-facing content, and stakeholder communications.
• Assess responses for clarity, accuracy, tone, usefulness, and adherence to instructions.
• Provide detailed rationales and actionable feedback for each evaluation.
• Identify content that is fluent but fails to address the intended question or user need.
• Detect factual inaccuracies, inconsistencies, and violations of prompt requirements.
• Collaborate virtually and asynchronously with project managers and reviewers to maintain evaluation quality and consistency.

Skills

Product Manager

Product Owner

English fluency

PRD creation

Specifications review

Independent worker

Remote work

AI model evaluation

Job description

YO AI Labs seeks experienced Product Managers and Product Owners to contribute to a customer project evaluating and improving AI systems. The role centers on evaluating AI-generated specifications, content, and documentation, with no roadmap ownership or delivery management involved.

Ideal candidates have PM/PO experience, native English fluency, and strong ability to provide detailed, actionable feedback asynchronously in a remote environment.