Senior AI Evaluation & Leaderboard Product Lead

Scale AI, Inc.; San Francisco (CA); On-site; USD 206,000 - 257,000; Full time

Benefits offered by this job

Health coverage

Dental & vision coverage

Retirement benefits

Learning & development stipend

Generous PTO

Commuter stipend

Job summary

Scale AI, Inc. is seeking a Senior AI Product Manager to own Scale's SEAL Leaderboard portfolio and drive the strategy, roadmap, and governance of evaluation products, benchmarks, and leaderboards.

You will collaborate with AI PM, ML researchers, Engineering, Operations, and GTM teams to turn evaluations into trusted industry benchmarks influencing model development and purchasing decisions. The role demands strong product judgment, technical fluency, operational rigor, and customer-facing

Qualifications

• 5+ years of experience in product management, technical program management, consulting, or customer-facing technical roles.
• Strong technical fluency, including familiarity with machine learning systems, AI model evaluation, benchmarking, or data products.
• Experience building and scaling products that require coordination across engineering, operations, and business teams.
• Excellent stakeholder management and executive communication skills, with a demonstrated ability to drive alignment across cross-functional organizations.

Responsibilities

• Own the roadmap and strategy for Scale's SEAL Leaderboard portfolio, defining priorities across benchmark development and launches.
• Drive governance, infrastructure investments, and product expansion for leaderboards and benchmarks.
• Collaborate with ML researchers, engineers, and GTM teams to transform evaluations into trusted industry benchmarks.
• Manage end-to-end lifecycle from ideation to sunset decisions, ensuring alignment with customer demand and market opportunities.

Skills

Product management

Technical fluency

Cross-functional collaboration

Stakeholder management

Analytical skills

AI/ML evaluation

Entrepreneurial mindset

Bias for action

Job description

Scale AI, Inc. is seeking a Senior AI Product Manager to own Scale's SEAL Leaderboard portfolio and drive the strategy, roadmap, and governance of evaluation products, benchmarks, and leaderboards.

You will collaborate with AI PM, ML researchers, Engineering, Operations, and GTM teams to turn evaluations into trusted industry benchmarks influencing model development and purchasing decisions. The role demands strong product judgment, technical fluency, operational rigor, and customer-facing