Principal Product Manager, AI Agent Evaluation

Socket.dev; Seattle (WA); On-site; USD 181,000 - 245,000; Full time

Benefits offered by this job

RSUs

Health insurance

401(k) matching

Paid time off

Job summary

Amazon Web Services (AWS) is seeking a Principal Product Manager, Technical to own and drive the product strategy, revenue, and adoption for AI Agent Evaluations within the Core Services AI Foundations team. You will define long-term vision, build the business around evaluation capabilities, and lead lifecycle management from concept through GTM for production-ready tooling and workflows.

You will work with engineering and applied science teams to translate research into scalable features,

Qualifications

• 7+ years as Technical Product Manager
• 5+ years in technical roles (software, network, IT)
• Experience delivering large-scale SaaS/PaaS/LaaS products from concept to GTM
• Experience with machine learning or AI systems and evaluation
• Proven ability to write clear technical product documents and drive engineering consensus

Responsibilities

• Define product vision and roadmap for automated evaluation pipelines and QA tooling
• Own GTM planning and pricing updates for features
• Lead product launches and drive customer adoption in production
• Collaborate with field, BD, and finance to optimize pricing and funnel

Skills

Strategic thinking

GTM leadership

ML/AI knowledge

Technical documentation

Education

MBA or advanced degree

Job description

Amazon Web Services (AWS) is seeking a Principal Product Manager, Technical to own and drive the product strategy, revenue, and adoption for AI Agent Evaluations within the Core Services AI Foundations team. You will define long-term vision, build the business around evaluation capabilities, and lead lifecycle management from concept through GTM for production-ready tooling and workflows.

You will work with engineering and applied science teams to translate research into scalable features,