Product Manager - AI Specifications

Obsidian; New York (NY); On-site; USD 90,000 - 130,000; Full time

Job summary

Obsidian is seeking experienced Product Managers, Product Designers, and Technical Product professionals to review AI-generated web application specifications before they're used in model evaluation. You will assess realism, completeness, and clarity, ensuring AI-generated applications can be built and tested against high-quality specifications.

You will evaluate whether product requests are realistic, complete, and unambiguous, verify alignment with test scenarios, and provide structured

Qualifications

• 3+ years of experience in Product Management, Technical Product Management, Product Design, or Business Analysis.
• Experience writing or reviewing product requirements, PRDs, user stories, or acceptance criteria.
• Strong understanding of modern web application workflows and user experiences.
• Excellent written communication and attention to detail.

Responsibilities

• Review AI-generated product specifications for web applications.
• Evaluate whether product requests are realistic, complete, and unambiguous.
• Verify that subsequent feature requests build correctly on the existing product state.
• Ensure product requirements align with associated browser-based test scenarios.
• Identify inconsistencies, missing requirements, or unclear acceptance criteria.
• Provide structured written feedback using project review guidelines.

Skills

Product Management

Product Design

Technical Product Management

Business Analysis

Written communication

Tools

PRDs

User stories

Acceptance criteria

Job description

We're looking for experienced Product Managers, Product Designers, and Technical Product professionals to help review AI-generated web application specifications before they're used in model evaluation. You'll evaluate whether product requests are realistic, internally consistent, and clearly defined, ensuring AI-generated applications can be built and tested against high-quality specifications.

What You'll Do

• Review AI-generated product specifications for web applications.

• Evaluate whether product requests are realistic, complete, and unambiguous.

• Verify that subsequent feature requests build correctly on the existing product state.

• Ensure product requirements align with associated browser-based test scenarios.

• Identify inconsistencies, missing requirements, or unclear acceptance criteria.

• Provide structured written feedback using project review guidelines.

We're Looking For

• 3+ years of experience in Product Management, Technical Product Management, Product Design, or Business Analysis.

• Experience writing or reviewing product requirements, PRDs, user stories, or acceptance criteria.

• Strong understanding of modern web application workflows and user experiences.

• Comfortable evaluating complex feature specifications and product logic.

• Excellent written communication and attention to detail.

• Experience working with engineering and QA teams is preferred.

Why Join?

• Help shape the quality of next-generation AI systems by reviewing real-world product specifications used in model evaluation.

• Apply your product expertise to challenging web application scenarios spanning user experience, feature design, and product logic.

• Work alongside experienced reviewers on a fast-paced, high-impact AI benchmarking initiative.