AI Platform Product Lead – Evaluation & Quality

Whoop; Boston (MA); On-site; USD 155,000 - 215,000; Full time

Benefits offered by this job

Equity

Benefits

Relocation assistance

Job summary

WHOOP is seeking a Senior Product Manager to lead the internal AI development platform and measure AI output quality across experiences. You will collaborate with ML researchers, engineers, and data scientists to align models, providers, and experiences while balancing cost and latency.

You will drive cross-team programs without direct authority, shape evaluation datasets, and steer the roadmap for an internal productivity platform that scales AI across WHOOP’s member-facing experiences.

Qualifications

• Experience shipping AI or ML products with probabilistic capability.
• Depth in evaluation and measurement: defined metrics and data-driven decisions.
• Working literacy in modern ML concepts such as fine-tuning and RL-based ideas.
• Experience with platform or internal-facing products used by other teams.
• Technical fluency to partner with researchers and engineers as a peer.
• Proven ability to drive cross-team programs with no direct authority.
• Strong business judgment: quantify tradeoffs and cost considerations.
• Comfort operating in ambiguity and narrowing to well-scoped bets.
• Nice to have: internal AI tooling, wearables or sensor data, SQL or scripting.
• Commitment to applying AI tools to daily work with high quality standards.

Responsibilities

• Shape how AI output quality is measured across WHOOP's AI experiences and the evaluation framework.
• Build an eval habit across the company: make evals self-serve and broadly used.
• Decide which models power which experiences, balancing quality, latency, and cost.
• Product-manage the internal AI development platform and drive adoption.
• Track AI unit economics, including cost per interaction and spend tradeoffs.
• Explore future AI capabilities and distill to a few well-scoped bets.

Skills

AI product management

Cross-team collaboration

ML knowledge

Platform products

Cost/benefit analysis

Tools

SQL

Scripting

Job description

WHOOP is seeking a Senior Product Manager to lead the internal AI development platform and measure AI output quality across experiences. You will collaborate with ML researchers, engineers, and data scientists to align models, providers, and experiences while balancing cost and latency.

You will drive cross-team programs without direct authority, shape evaluation datasets, and steer the roadmap for an internal productivity platform that scales AI across WHOOP’s member-facing experiences.