Principal Data Scientist — Store Quality & Metrics

Amazon; Seattle (WA); On-site; USD 189,000 - 256,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon.com LLC is seeking a Principal Data Scientist to own the analytical rigor behind store quality metrics end-to-end. You will define definitions, ensure faithful LLM implementations, and assess judgments across relevance, presentation, product quality, and duplicates.

Build tooling to make validation repeatable and extend the methodology to detail pages and search. You will drive cross-organizational alignment, present evidence to Stores and Ads stakeholders, and shape experiments that

Qualifications

• Graduate degree in a quantitative field or equivalent depth built through experience.
• Experience as a data scientist with technical leadership on ambiguous, high-visibility problems.
• Fluent in statistical inference, experimental design, and sampling methodology.
• Production-quality code in Python and SQL.
• Owned metrics that informed decisions and defended them under scrutiny.

Responsibilities

• Validate store quality metrics end-to-end: inspect metric definitions, audit LLM implementations, and evaluate LLM judgment accuracy across quality dimensions (relevance, presentation, product quality, duplicates)
• Starting with Homepage, extending cross-page — identify gaps and inconsistencies between Organic and Ads treatments that block the tiered enforcement framework
• Drive alignment through deep dives that present evidence to both Stores and Ads stakeholders
• Build and deliver deep-dive tooling (walk-the-store bots, automated experiment inspection via Gecko, VoC feedback loops) that make metric validation repeatable and self-serve
• Own the analytical rigor behind the alignment on definitions of subjective/debated metrics and moving them to aligned/enforceable

Skills

Statistical inference

Experimental design

Data science leadership

Education

Graduate degree in a quantitative field

Tools

Python

SQL

Job description

Amazon.com LLC is seeking a Principal Data Scientist to own the analytical rigor behind store quality metrics end-to-end. You will define definitions, ensure faithful LLM implementations, and assess judgments across relevance, presentation, product quality, and duplicates.

Build tooling to make validation repeatable and extend the methodology to detail pages and search. You will drive cross-organizational alignment, present evidence to Stores and Ads stakeholders, and shape experiments that