Product Manager - Remote

YO AI Labs; Kraków; Remote; PLN 165,000 - 248,000; Full time

Job summary

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote evaluation role focused on evaluating and improving AI system outputs. No prior AI experience required. This is an evaluation and analysis role, not a roadmap or delivery management position.

Candidates should bring strong PM/PO experience, excellent English, and the ability to produce clear, actionable feedback for technical stakeholders and executives in a remote setting.

Qualifications

• Must have product management or product ownership experience.
• Native-level English proficiency and strong written communication.
• Experience creating and reviewing PRDs, specs, acceptance criteria, release notes, or decision docs.
• Ability to evaluate content for technical stakeholders, executives, and end users.

Responsibilities

• Evaluate AI-generated specifications, release notes, content, and communications.
• Assess responses for clarity, accuracy, tone, usefulness, and instruction adherence.
• Provide detailed rationales and actionable feedback for each evaluation.
• Identify content that is fluent but misses the user need; detect factual inaccuracies.

Skills

Product management

English fluency

PRD/spec reviews

stakeholder evaluation

critical thinking

remote work independence

Job description

Product Manager / Product Owner

Role Type: Contractor
Location: Remote

We are seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving advanced AI systems.

You'll apply your product expertise to assess AI-generated content, specifications, and product documentation. No prior AI experience is required.

This is strictly an evaluation and analysis role. It does not involve roadmap ownership, delivery management, sprint facilitation, stakeholder leadership, or program management. Candidates should have strong product management or product ownership experience.

Scope of Work

• Evaluate and compare AI-generated specifications, release notes, user-facing content, and stakeholder communications.
• Assess responses for clarity, accuracy, tone, usefulness, and adherence to instructions.
• Provide detailed rationales and actionable feedback for each evaluation.
• Identify content that is fluent but fails to address the intended question or user need.
• Detect factual inaccuracies, inconsistencies, and violations of prompt requirements.
• Collaborate virtually and asynchronously with project managers and reviewers to maintain evaluation quality and consistency.

Preferred Qualifications

• Professional experience as a Product Manager or Product Owner.
• Native-level English fluency and excellent written communication skills.
• Experience creating and reviewing PRDs, specifications, acceptance criteria, release notes, or decision documents.
• Ability to evaluate content for technical stakeholders, executives, and end users.
• Strong critical analysis, attention to detail, and written feedback skills.
• Ability to work independently and meet deadlines in a remote environment.
• Familiarity with AI model evaluation, RLHF, or annotation is a plus, but not required.