Lead AI Benchmark Leaderboards & Evaluation Products

Scale AI, Inc.; New York (NY); On-site; USD 206,000 - 257,000; Full time

Benefits offered by this job

Equity compensation

Health, dental and vision benefits

Learning and development stipend

Generous PTO

Commuter stipend

Job summary

Scale AI, Inc. is seeking a Senior AI Product Manager to own and scale the SEAL Leaderboard portfolio, defining strategy and the roadmap for benchmark development and product expansion.

You will drive governance, infrastructure, and automation to boost scalability and lead end-to-end lifecycle management. You will partner with ML researchers, engineering, and GTM teams to deliver trusted evaluation products, engage with frontier labs and enterprise customers, and measure adoption and business

Qualifications

• 5+ years of experience in product management, technical program management, consulting, or customer-facing technical roles.
• Strong technical fluency with machine learning systems, AI model evaluation, benchmarking, or data products.
• Experience building and scaling products requiring cross-functional coordination.
• Excellent stakeholder management and executive communication skills.
• Analytical skills to translate market and customer signals into strategy.
• Experience with AI researchers, ML teams, or evaluation frameworks is preferred.

Responsibilities

• Own the roadmap and strategy for Scale's SEAL Leaderboard portfolio, defining priorities across benchmark development and product expansion.
• Lead governance, infrastructure, and automation initiatives to improve scalability and reduce manual effort.
• Drive end-to-end product lifecycle from ideation to launch, growth, maintenance, and sunset decisions.
• Collaborate with ML researchers and domain experts to develop evaluation methodologies and scoring frameworks.
• Work with frontier AI labs and enterprise customers to understand needs and influence investments.
• Track adoption and business impact, using data-driven insights for resource allocation.

Job description

Scale AI, Inc. is seeking a Senior AI Product Manager to own and scale the SEAL Leaderboard portfolio, defining strategy and the roadmap for benchmark development and product expansion.

You will drive governance, infrastructure, and automation to boost scalability and lead end-to-end lifecycle management. You will partner with ML researchers, engineering, and GTM teams to deliver trusted evaluation products, engage with frontier labs and enterprise customers, and measure adoption and business