Sr Product Manager, Technical, Core Shopping Data Science

Amazon; Seattle (WA); On-site; USD 151,000 - 205,000; Full time

Benefits offered by this job

Health insurance

RSUs

401(k) matching

Job summary

Amazon seeks a senior product/ program leader to own the quality measurement bar for shopping experiences. You will define metric definitions, drive a portfolio of quality metrics, and ensure online measurement integrates into evaluation paths.

You will guide audit loops, SOPs, and lead cross-functional collaboration with UX, engineering, and leadership. The role emphasizes transforming qualitative customer signals into quantitative metrics, expanding measurement beyond search to homepage and

Qualifications

• 5+ years of product or program management, product marketing, business development or technology experience
• Bachelor's degree in a relevant field
• Experience with feature delivery and tradeoffs of a product
• Experience owning/driving roadmap strategy and definition
• Experience with end to end product delivery
• Experience contributing to engineering discussions around technology decisions and strategy related to a product
• Experience managing technical products or online services
• Experience in representing and advocating for a variety of critical customers and stakeholders during executive-level prioritization and planning

Responsibilities

• Own the standard that every metric definition, annotation SOP, and automated measurement approach must satisfy before it can be trusted or published.
• Own the portfolio of shopping quality metrics against that bar, covering areas such as relevance, duplication, and brand quality, and grow that portfolio as new defect classes are identified.
• Own how we find quality defects, not just how we count the ones we already know about: sampling strategy, audit cadence, anecdote review, and systematic inspection of pages customers actually saw.
• Turn qualitative signal into quantified metrics. Work with UX Research and leadership to convert customer anecdotes and research findings into defect definitions that can be sampled, scored, and tracked.
• Own the audit loop and the SOP bar. Specify what gets audited and against which criteria, review findings, and require the resulting corrections in annotation SOPs or LLM prompts.

Skills

5+ years PM/Program management

Bachelor's degree

Feature delivery

Roadmap strategy

End-to-end delivery

Engineering discussions

Technical products

Executive stakeholder advocacy

Education

Bachelor's degree

Tools

Tableau

QlikView

QuickSight

Job description

Description

Amazon cannot fix a customer experience problem it cannot measure. Our team's job is to make shopping quality measurable: to find the defects customers actually encounter, quantify how often they encounter them, and put a number in front of leadership that teams are willing to be held to. Today that capability is strongest on the search results page, where we run a portfolio of quality metrics covering areas such as relevance, duplication, and brand quality, backed by a mix of human annotation and LLM based measurement.

Amazon cannot fix a customer experience problem it cannot measure. Our team's job is to make shopping quality measurable: to find the defects customers actually encounter, quantify how often they encounter them, and put a number in front of leadership that teams are willing to be held to. Today that capability is strongest on the search results page, where we run a portfolio of quality metrics covering areas such as relevance, duplication, and brand quality, backed by a mix of human annotation and LLM based measurement.

Key job responsibilities

Define The Quality Bar

• Own the standard that every metric definition, annotation SOP, and automated measurement approach must satisfy before it can be trusted or published. Scientists, engineers, and annotation partners build to that bar.
• Own the portfolio of shopping quality metrics against that bar, covering areas such as relevance, duplication, and brand quality, and grow that portfolio as new defect classes are identified.

Own the inspection mechanisms

• Own how we find quality defects, not just how we count the ones we already know about: sampling strategy, audit cadence, anecdote review, and systematic inspection of pages customers actually saw.
• Turn qualitative signal into quantified metrics. Work with UX Research and leadership to convert customer anecdotes and research findings into defect definitions that can be sampled, scored, and tracked.
• Own the audit loop and the SOP bar. Specify what gets audited and against which criteria, review findings, and require the resulting corrections in annotation SOPs or LLM prompts. When a measurement approach systematically misses a defect class, you own defining what the corrected standard is, and the team builds to it.

Drive quality measurement into online systems

• Drive the agenda to move quality measurement from offline, after the fact reporting into online systems, so that quality signals are available where experiences are ranked and served rather than only in a periodic report.
• Partner with central platform teams to embed quality metrics into online evaluation and serving paths.
• Make the case for where online quality signals change decisions, including experimentation guardrails, faster detection of quality regressions, and closed loop correction of defective experiences.

Own the roadmap

• Own the multi year roadmap for shopping quality measurement and inspection: which defects to measure next, which surfaces to expand to, and what each expansion unblocks for the business.
• Extend the charter beyond search to other core shopping pages, starting with Homepage and Detail Page. For surfaces with no measurement today, define the defect taxonomy from scratch: what a quality defect is on that page, how it is sampled, how it is scored, and how it rolls up.
• Drive alignment across Organic Search, Sponsored Products, Sponsored Brands, and International as definitions evolve, including with the teams whose experiences the metrics judge.

About The Team

The mission of the Core Shopping Data Science team is to provide the data-driven foundation for building a world-class shopping experience that maximizes long-term free cash flow by delighting customers. We focus on the long term and big picture to ensure that the full Amazon shopping experience balances strategic trade-offs. We believe data science is the discipline of making smart decisions and we empower feature owners and systems by 1) developing and vending metrics which assess and value customer engagement, 2) building tools and datasets to inject data into the decision-making process, and 3) delivering deep analyses to inform high-touch decisions.

Basic Qualifications

• 5+ years of product or program management, product marketing, business development or technology experience
• Bachelor's degree
• Experience with feature delivery and tradeoffs of a product
• Experience owning/driving roadmap strategy and definition
• Experience with end to end product delivery
• Experience contributing to engineering discussions around technology decisions and strategy related to a product
• Experience managing technical products or online services
• Experience in representing and advocating for a variety of critical customers and stakeholders during executive-level prioritization and planning

Preferred Qualifications

• Experience in using analytical tools, such as Tableau, Qlikview, QuickSight
• Experience in building and driving adoption of new tools

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, Seattle - 151,200.00 - 204,600.00 USD annually

Company - Amazon.com Services LLC

Job ID: A10560814