Platform Product Manager – AI Evaluation & Agentic Testing

Relativity

Springfield (IL)

Hybrid

USD 115,000 - 173,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive base salary
Annual performance bonus
Long-term incentives

Job summary

Relativity in the United States is seeking a Product Manager to own the Evaluations Platform roadmap, enabling AI teams to measure and improve performance across offline/online evaluation, dashboards, and agentic testing.

You will work with applied scientists, engineers, and legal experts to define tasks, build SME workflows, and ship high-impact capabilities with a focus on fast, safe delivery in a rapidly changing AI landscape. This is a hybrid role.

Qualifications

  • 4+ years of product management experience at a technology company.
  • 2+ years on technical, platform, infrastructure, or data/ML products.
  • Excellent written and verbal communication for technical and non-technical audiences.

Responsibilities

  • Own the product vision, strategy, and roadmap for the Evaluations Platform.
  • Collaborate with applied scientists, engineers, PMs, and legal to understand needs.
  • Lead agentic testing system design, calibration, and production monitoring.
  • Define SME authoring/approval workflows and build dashboards for teams.

Skills

Agile Methodology
Cross-Functional Teamwork
Market Research
Market Strategy
Product Lifecycle
PLM
Product Management
Product Strategies
Stakeholder Management
Team Leadership

Job description

Relativity in the United States is seeking a Product Manager to own the Evaluations Platform roadmap, enabling AI teams to measure and improve performance across offline/online evaluation, dashboards, and agentic testing.

You will work with applied scientists, engineers, and legal experts to define tasks, build SME workflows, and ship high-impact capabilities with a focus on fast, safe delivery in a rapidly changing AI landscape. This is a hybrid role.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Evaluation Platform Product Manager
AI Evaluation Platform Product Manager

Relativity • Chicago (IL)

Remote
USD 115,000 - 173,000
AI Platform PM: Evaluations & Agentic Testing
AI Platform PM: Evaluations & Agentic Testing

Relativity • Illinois

Hybrid
USD 115,000 - 173,000
Product Manager - AI Evaluations Tooling
Product Manager - AI Evaluations Tooling

Relativity • Springfield (IL)

Hybrid
USD 115,000 - 173,000
Competitive base salary
Annual performance bonus
Long-term incentives
Product Manager - AI Evaluations Tooling
Product Manager - AI Evaluations Tooling

Relativity • Chicago (IL)

Remote
USD 115,000 - 173,000
Product Manager - AI Evaluations Tooling
Product Manager - AI Evaluations Tooling

Relativity • Illinois

Hybrid
USD 115,000 - 173,000
Senior AI Product Manager: Systems & Reliability (Remote)
Senior AI Product Manager: Systems & Reliability (Remote)

Parallel Partners, Inc. • San Francisco (CA)

Remote
USD 165,000 - 200,000
Medical insurance
Dental insurance
Vision insurance
+2
AI Product Manager
AI Product Manager

Rex.zone • United States

On-site
USD 110,000 - 150,000
Remote AI Product Lead: Evaluation & Governance
Remote AI Product Lead: Evaluation & Governance

Optum • Eden Prairie (MN)

Hybrid
USD 92,000 - 164,000
Remote work
Comprehensive benefits
Product Manager - AI Evaluation & Agentic Platform
Product Manager - AI Evaluation & Agentic Platform

Meta • Menlo Park (CA)

Hybrid
USD 180,000 - 240,000
Remote Product Manager - AI Content Evaluation (Contract)
Remote Product Manager - AI Content Evaluation (Contract)

YO AI Labs • Chicago (IL)

Remote
USD 90,000 - 120,000