Principal Data Scientist — Shopping Quality & Metrics

Amazon; Berwick (Columbia County); On-site; USD 190,000 - 295,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon seeks a Principal Data Scientist to own the analytical rigor behind store quality metrics end-to-end, defining how metrics are measured, how LLMs are evaluated, and how judgments translate into business actions. You will build tooling and extend validation from Homepage to Detail Page and Search, coordinating with Stores and Ads teams.

We value leadership on ambiguous problems and a track record of production-grade Python/SQL work in large data environments.

Qualifications

• Graduate degree in quantitative field or equivalent experience.
• Fluent in statistical inference, experimental design, and sampling methodology.
• Production-quality Python and SQL coding experience.
• Experience leading high-visibility data science projects.

Responsibilities

• Validate store quality metrics end-to-end: inspect metric definitions, audit LLM implementations, and evaluate LLM judgment accuracy across quality dimensions.
• Extend cross-page measurement with Homepage first, identifying gaps between Organic and Ads treatments.
• Drive alignment by presenting evidence to Stores and Ads stakeholders.
• Build and deliver deep-dive tooling (walk-the-store bots, Gecko-inspection, VoC loops) for repeatable validation.
• Own definitions of subjective metrics and push for enforceable standards.

Job description

Amazon seeks a Principal Data Scientist to own the analytical rigor behind store quality metrics end-to-end, defining how metrics are measured, how LLMs are evaluated, and how judgments translate into business actions. You will build tooling and extend validation from Homepage to Detail Page and Search, coordinating with Stores and Ads teams.

We value leadership on ambiguous problems and a track record of production-grade Python/SQL work in large data environments.