Lead Data Scientist, Experimentation & AI Evaluation

Walmart; Bentonville (AR); On-site; USD 110,000 - 220,000; Full time

Benefits offered by this job

Medical, vision, and dental coverage

401(k) and stock purchase program

Paid time off including sick leave

Job summary

Walmart is seeking a Principal Data Scientist to define and execute the data science roadmap for the experimentation platform powering trusted decision-making across Walmart’s A/B testing ecosystem. The role blends strategy with hands-on prototyping, focusing on robust measurement, dashboards, guardrails, and AI evaluation.

The team oversees scalable data infrastructure, ETL pipelines, and measurement systems to deliver reliable experiment outcomes.

Qualifications

• Hands-on experience with SQL, Spark/PySpark, experimentation at production scale.

Responsibilities

• Define the multi-year data science roadmap for experimentation reporting, dashboards, and measurement services.
• Lead scalable statistical frameworks for online experiments across product, business, and operations.
• Partner with data engineering to design robust SQL and PySpark data models and pipelines.
• Establish canonical experiment metrics, scorecards, and reporting standards across channels and regions.
• Define AI-native experimentation and evaluation strategy, including LLM eval frameworks and prompt evaluation.
• Build lightweight proofs of concept and small automated workflows using Python, SQL, Airflow, and GCP.
• Serve as senior technical advisor on experimental design, causal inference, and measurement risk.

Skills

Experimentation

Causal inference

SQL

PySpark

Python

Data pipelines

A/B testing

AI evaluation

Education

Bachelor's degree in Statistics/Analytics/CS

Master's degree in Statistics/Analytics

PhD in related field

Tools

Airflow

Google Cloud Platform

Job description

Walmart is seeking a Principal Data Scientist to define and execute the data science roadmap for the experimentation platform powering trusted decision-making across Walmart’s A/B testing ecosystem. The role blends strategy with hands-on prototyping, focusing on robust measurement, dashboards, guardrails, and AI evaluation.

The team oversees scalable data infrastructure, ETL pipelines, and measurement systems to deliver reliable experiment outcomes.