Remote Product Evaluator: AI Content & Specs

YO AI Labs; Çankaya; Remote; TRY 2,709,000 - 4,064,000; Part time

Job summary

YO AI Labs is seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving advanced AI systems.

You will apply your product expertise to assess AI-generated content, specifications, and product documentation, with no prior AI experience required. This is a contractor evaluation and analysis role, not roadmap ownership or delivery management.

Qualifications

• Professional experience as a Product Manager or Product Owner.
• Native-level English fluency and excellent written communication.
• Experience creating and reviewing PRDs, specifications, acceptance criteria, or release notes.
• Ability to evaluate content for technical stakeholders, executives, and end users.
• Strong critical analysis, attention to detail, and written feedback skills.
• Ability to work independently and meet deadlines in a remote environment.
• Familiarity with AI model evaluation, RLHF, or annotation is a plus, but not required.

Responsibilities

• Evaluate and compare AI-generated specifications, release notes, user content, and stakeholder communications.
• Assess responses for clarity, accuracy, tone, usefulness, and adherence to instructions.
• Provide detailed rationales and actionable feedback for each evaluation.
• Identify content that is fluent but fails to address the intended question or user need.
• Detect factual inaccuracies, inconsistencies, and violations of prompt requirements.
• Collaborate virtually and asynchronously with project managers and reviewers to maintain evaluation quality and consistency.

Skills

Product management

Product ownership

English fluency

Written communication

Critical thinking

Independent work

Remote work

Job description

YO AI Labs is seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving advanced AI systems.

You will apply your product expertise to assess AI-generated content, specifications, and product documentation, with no prior AI experience required. This is a contractor evaluation and analysis role, not roadmap ownership or delivery management.