Remote Product Evaluator for AI Content & Specs

YO AI Labs; Espoo; Remote; EUR 74,000 - 111,000; Full time

Job summary

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote contractor role focused on evaluating and improving AI-generated content, specifications, and product documentation. No prior AI experience is required.

You'll assess content for clarity, accuracy, tone, usefulness, and adherence to instructions, providing detailed rationales and actionable feedback to ensure quality and relevance for technical stakeholders, executives, and end users.

Qualifications

• Experience as Product Manager or Product Owner.
• Native-level English fluency and strong written communication.
• Experience creating/reviewing PRDs, specs, acceptance criteria, release notes or decision documents.
• Ability to evaluate content for technical stakeholders, executives and end users.
• Strong critical analysis, attention to detail, and written feedback skills.
• Ability to work independently and meet deadlines in a remote environment.
• Familiarity with AI model evaluation, RLHF, or annotation is a plus but not required.

Responsibilities

• Evaluate and compare AI-generated specifications, release notes, user-facing content, and stakeholder communications.
• Assess responses for clarity, accuracy, tone, usefulness, and adherence to instructions.
• Provide detailed rationales and actionable feedback for each evaluation.
• Identify content that is fluent but fails to address the intended question or user need.
• Detect factual inaccuracies, inconsistencies, and violations of prompt requirements.
• Collaborate virtually and asynchronously with project managers and reviewers to maintain evaluation quality and consistency.

Skills

PM/PO experience

English fluency

PRDs & specs

Stakeholder evaluation

Critical analysis

Self-motivation

AI evaluation familiarity

Job description

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote contractor role focused on evaluating and improving AI-generated content, specifications, and product documentation. No prior AI experience is required.

You'll assess content for clarity, accuracy, tone, usefulness, and adherence to instructions, providing detailed rationales and actionable feedback to ensure quality and relevance for technical stakeholders, executives, and end users.