Remote Product Evaluator: AI Content & Specs Specialist

YO AI Labs; Województwo mazowieckie; Remote; PLN 135,000 - 325,000; Part time

Job summary

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote evaluation-focused project. You will assess AI-generated content, specifications and communications, providing detailed rationales and actionable feedback. No roadmap ownership or delivery management is required.

Candidates should have strong PM/PO experience, native English, and the ability to work independently in a remote setting, with attention to accuracy and clarity in evaluations.

Qualifications

• Professional experience as a Product Manager or Product Owner.
• Native-level English fluency with excellent written communication.
• Experience creating and reviewing PRDs, specifications, acceptance criteria, release notes, or decision documents.
• Ability to evaluate content for technical stakeholders, executives and end users.
• Strong analysis, attention to detail and ability to provide clear feedback.
• Ability to work independently and meet deadlines in a remote environment.
• Familiarity with AI model evaluation or RLHF is a plus but not required.

Responsibilities

• Evaluate AI-generated specifications, release notes and user-facing content.
• Assess content for clarity, accuracy, tone, usefulness and instruction adherence.
• Provide detailed rationales and actionable feedback for each evaluation.
• Identify content that is fluent but misses the user question or need.
• Detect factual inaccuracies, inconsistencies and prompt violations.
• Collaborate virtually with project managers and reviewers to ensure quality.

Skills

Product management

Product ownership

English writing

PRD creation/review

Requirements specs

Critical analysis

Attention to detail

Remote work

Independent work

Feedback writing

AI model evaluation

Job description

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote evaluation-focused project. You will assess AI-generated content, specifications and communications, providing detailed rationales and actionable feedback. No roadmap ownership or delivery management is required.

Candidates should have strong PM/PO experience, native English, and the ability to work independently in a remote setting, with attention to accuracy and clarity in evaluations.