AI Content Evaluation Specialist (Remote)

YO AI Labs; San Francisco (CA); À distance; USD 96 000 - 165 000; Temps partiel

Résumé du poste

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote contractor role focused on evaluating and improving AI system outputs. You will assess AI-generated content, specifications, and product documentation, providing detailed feedback.

No prior AI experience is required, and the role emphasizes evaluation, analysis, and clear written communication. Candidates should have strong PM/PO experience, English fluency, and the ability to work independently in a remote

Qualifications

• Professional experience as a Product Manager or Product Owner.
• Native-level English fluency and excellent written communication.
• Experience creating and reviewing PRDs, specifications, acceptance criteria, release notes, or decision documents.
• Ability to evaluate content for technical stakeholders, executives, and end users.
• Strong critical analysis, attention to detail, and written feedback.
• Ability to work independently and meet deadlines in a remote environment.
• Familiarity with AI model evaluation, RLHF, or annotation is a plus but not required.

Responsabilités

• Evaluate and compare AI-generated specifications, release notes, user-facing content, and stakeholder communications.
• Assess responses for clarity, accuracy, tone, usefulness, and adherence to instructions.
• Provide detailed rationales and actionable feedback for each evaluation.
• Identify content that is fluent but fails to address the intended question or user need.
• Detect factual inaccuracies, inconsistencies, and violations of prompt requirements.
• Collaborate virtually and asynchronously with project managers and reviewers to maintain evaluation quality.

Connaissances

Product Manager

Product Owner

English fluency

Technical writing

Attention to detail

Independent work

Remote collaboration

Description du poste

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote contractor role focused on evaluating and improving AI system outputs. You will assess AI-generated content, specifications, and product documentation, providing detailed feedback.

No prior AI experience is required, and the role emphasizes evaluation, analysis, and clear written communication. Candidates should have strong PM/PO experience, English fluency, and the ability to work independently in a remote