Remote AI Product Evaluator (Contractor)

Synthires; California (MO); Remote; USD 124,000 - 193,000; Full time

Job summary

Synthires is seeking experienced Product Managers or Product Owners for a remote, contractor engagement focused on AI system development and evaluation. You will train and evaluate AI content, assess how it meets product and user needs, and provide detailed rationales.

No prior AI experience required beyond product leadership strengths. This is an evaluation and analysis role with no roadmap or sprint leadership duties.

Qualifications

• Experience as Product Manager or Product Owner.
• Native-level English and excellent written communication.
• Experience creating/evaluating product specs, PRDs, acceptance criteria, release notes, or decision docs.
• Ability to tailor content for executives, technical stakeholders and end users.
• Ability to provide actionable written feedback on technical and user docs.
• Strong attention to detail and critical analysis.

Responsibilities

• Assess and compare AI-generated responses to product and business writing prompts.
• Evaluate content including product specifications, release notes, user-facing copy, and stakeholder updates.
• Score responses based on clarity, tone, instruction adherence, accuracy and usefulness for the audience.
• Write detailed evaluation rationales explaining the reasoning behind each assessment.
• Determine whether generated content addresses prompt requirements and audience needs.
• Identify cases where content is fluent but fails to answer the underlying question or is unsuitable for users.
• Collaborate asynchronously with project managers and reviewers to maintain consistency and quality.

Skills

Product Manager

Product Owner

English fluency

Written feedback

Attention to detail

Remote work

Cross-functional

Job description

Synthires is seeking experienced Product Managers or Product Owners for a remote, contractor engagement focused on AI system development and evaluation. You will train and evaluate AI content, assess how it meets product and user needs, and provide detailed rationales.

No prior AI experience required beyond product leadership strengths. This is an evaluation and analysis role with no roadmap or sprint leadership duties.