Senior AI Product Manager, Coding Benchmarks & Data

Scale AI; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Scale AI is seeking a Senior AI Product Manager to own and scale the Coding portfolio, defining the strategy, roadmap, and operational excellence of coding data products, RL environments, and agentic coding evaluations.

You will work across AI Product Management, ML Researchers, Engineering, Operations, and GTM teams to turn benchmark credibility into a durable, revenue-generating product line that leading labs depend on to train the next generation of software engineering agents.

Responsibilities

• Own the Coding portfolio roadmap and strategy, defining priorities across SFT and preference data, reinforcement learning environments, agentic task suites, and evaluation products.
• Extend the SWE-Bench Pro and SWE Atlas franchises; decide what comes next as agents saturate current tasks, and convert benchmark authority into training-data and environment revenue.
• Drive alignment among AI-PM, ML, Engineering, Operations, and GTM stakeholders to ensure customer demand and model capability frontiers are reflected in the product roadmap.

Job description

Scale AI is seeking a Senior AI Product Manager to own and scale the Coding portfolio, defining the strategy, roadmap, and operational excellence of coding data products, RL environments, and agentic coding evaluations.

You will work across AI Product Management, ML Researchers, Engineering, Operations, and GTM teams to turn benchmark credibility into a durable, revenue-generating product line that leading labs depend on to train the next generation of software engineering agents.