Head of AI Product - Open-Source Eval & Tools

Sentient Foundation

New York (NY)

On-site

USD 140,000 - 200,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Sentient Foundation in New York, NY seeks a Head of Product to turn research into shipped, public-facing products: agent evaluation platforms, benchmarks, leaderboards, datasets, developer tools, and community launches. You’ll own the Foundation’s product function and roadmap, and lead the Agents & Evaluation product effort, collaborating across research, engineering, design, marketing, BD, and community.

This is a senior, 0-to-1 leadership role where you will define new product practices and

Qualifications

  • Requires 4+ years in AI/ML or developer platforms with leadership experience.
  • Proven ability to ship complex 0-to-1 products in ambiguous environments.
  • Excellent communication to translate technical work into clear product narratives.

Responsibilities

  • Own 0-to-1 launches end-to-end: translate research agendas into product specs and success metrics.
  • Own the Foundation’s product function: strategy, roadmap, and priorities; lead the Agents & Evaluation team.
  • Translate research from Sentient Labs into Foundation products and align roadmaps across organizations.
  • Package technical work into usable products: docs, demos, benchmarks, leaderboards, developer workflows.
  • Run developer-facing programs: public challenges, hackathons, and partner launches.
  • Build feedback loops from developers, researchers, partners, and open-source contributors into the roadmap.
  • Shape product strategy for emerging categories like agent evaluation and open-source AI distribution.

Skills

Product leadership
AI/ML product
Cross-functional collaboration
Shipping 0-to-1 products
Communication skills

Job description

Sentient Foundation in New York, NY seeks a Head of Product to turn research into shipped, public-facing products: agent evaluation platforms, benchmarks, leaderboards, datasets, developer tools, and community launches. You’ll own the Foundation’s product function and roadmap, and lead the Agents & Evaluation product effort, collaborating across research, engineering, design, marketing, BD, and community.

This is a senior, 0-to-1 leadership role where you will define new product practices and

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Head of AI Product & Open Platform Growth
Head of AI Product & Open Platform Growth

Sentient Foundation • Seattle (WA)

On-site
USD 180,000 - 280,000
Head of Product
Head of Product

Sentient Foundation • New York (NY)

On-site
USD 140,000 - 200,000
Head of Product
Head of Product

Sentient Foundation • Seattle (WA)

On-site
USD 180,000 - 280,000
AI Product Leader — Internal Agents & Platform Innovation
AI Product Leader — Internal Agents & Platform Innovation

Wise Insight • New York (NY)

On-site
USD 140,000 - 190,000
Principal Product Manager, AI Agent Evaluation
Principal Product Manager, AI Agent Evaluation

Socket.dev • Seattle (WA)

On-site
USD 181,000 - 245,000
RSUs
Health insurance
401(k) matching
+1
Senior Product Manager, AI Agent Evaluation & Quality Tools
Senior Product Manager, AI Agent Evaluation & Quality Tools

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 151,000 - 205,000
Health insurance
RSUs
401(k) matching
+1
Staff Product Engineer: AI-Agent Platform Lead
Staff Product Engineer: AI-Agent Platform Lead

People In AI • New York (NY)

On-site
USD 250,000 - 300,000
Meaningful equity
Senior Product Marketing Lead - AI Platforms & Frontiers
Senior Product Marketing Lead - AI Platforms & Frontiers

Triwill Group • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Hybrid work model
Relocation assistance
Senior Product Manager: AI Agent Evaluation & Tools
Senior Product Manager: AI Agent Evaluation & Tools

Amazon • Seattle (WA)

On-site
USD 151,000 - 205,000
RSUs and sign-on
Health insurance
401(k) matching
Senior AI Leaderboard Product Manager — NYC
Senior AI Leaderboard Product Manager — NYC

Scale AI, Inc. • New York (NY)

On-site
USD 206,000 - 257,000
Health benefits
Dental & Vision insurance
Retirement benefits
+3