Remote Product Evaluator: AI Content & Docs Analyst

YO AI Labs; Jeddah; Remote; SAR 225,000 - 337,000; Full time

Job summary

YO AI Labs seeks experienced Product Managers and Product Owners to contribute to a customer project evaluating and improving advanced AI systems. Remote, contractor role.

You will assess AI-generated specifications, content, and communications, provide detailed rationales and feedback, and work asynchronously with project managers and reviewers to ensure quality. Prior AI experience is not required if you have solid product management background and can meet deadlines remotely.

Qualifications

• Professional experience as a Product Manager or Product Owner.
• Native-level English fluency and excellent written communication skills.
• Experience creating and reviewing PRDs, specifications, acceptance criteria, release notes, or decision documents.
• Ability to evaluate content for technical stakeholders, executives, and end users.
• Strong critical analysis, attention to detail, and written feedback skills.
• Ability to work independently and meet deadlines in a remote environment.
• Familiarity with AI model evaluation, RLHF, or annotation is a plus, but not required.

Responsibilities

• Evaluate and compare AI-generated specifications, release notes, user-facing content, and stakeholder communications.
• Assess responses for clarity, accuracy, tone, usefulness, and adherence to instructions.
• Provide detailed rationales and actionable feedback for each evaluation.
• Identify content that is fluent but fails to address the intended question or user need.
• Detect factual inaccuracies, inconsistencies, and violations of prompt requirements.
• Collaborate virtually and asynchronously with project managers and reviewers to maintain evaluation quality and consistency.

Skills

Product Manager or Product Owner

Native-level English

Written communication

Independent remote work

Deadline driven

Tools

PRDs

Specifications

Acceptance criteria

Release notes

Job description

YO AI Labs seeks experienced Product Managers and Product Owners to contribute to a customer project evaluating and improving advanced AI systems. Remote, contractor role.

You will assess AI-generated specifications, content, and communications, provide detailed rationales and feedback, and work asynchronously with project managers and reviewers to ensure quality. Prior AI experience is not required if you have solid product management background and can meet deadlines remotely.