Remote Product Manager - AI Evaluation Specialist

YO AI Labs; Paris; Remote; EUR 83,000 - 124,000; Full time

Job summary

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote evaluation-focused role. You will assess AI-generated content, specifications, and documentation, providing detailed feedback without roadmap ownership or delivery management responsibilities.

Strong product management experience, native English, and ability to work independently in a remote setup are essential. Prior AI evaluation familiarity is a plus but not required.

Qualifications

• Proven experience as Product Manager or Product Owner.
• Native-level English with excellent writing skills.
• Experience creating PRDs, specifications, acceptance criteria, release notes, or decision documents.
• Ability to evaluate content for technical stakeholders and end users.
• Strong analytical thinking and attention to detail.
• Ability to work independently in a remote environment.
• Familiarity with AI model evaluation is a plus.

Responsibilities

• Evaluate and compare AI-generated specifications, release notes, user-facing content, and stakeholder communications.
• Assess responses for clarity, accuracy, tone, usefulness, and adherence to instructions.
• Provide detailed rationales and actionable feedback for each evaluation.
• Identify content that is fluent but fails to address the intended question or user need.
• Detect factual inaccuracies, inconsistencies, and violations of prompt requirements.
• Collaborate virtually and asynchronously with project managers and reviewers to maintain evaluation quality and consistency.

Skills

Product Management

Product Ownership

Remote work

Attention to detail

Written communication

Job description

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote evaluation-focused role. You will assess AI-generated content, specifications, and documentation, providing detailed feedback without roadmap ownership or delivery management responsibilities.

Strong product management experience, native English, and ability to work independently in a remote setup are essential. Prior AI evaluation familiarity is a plus but not required.