Principal Data Scientist, Platform Measurement & Evaluation

Zillow Group

United States

Remote

USD 173,000 - 291,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Zillow Group is seeking a Principal Data Scientist to be a measurement and impact partner in CoreTech. You will own four outcomes: quantify what shipped, what moved, and what didn’t; define metrics for CP and other platforms; build evaluation layers for LLM-based and agentic systems; and instrument these metrics with engineering across events, pipelines, and dashboards.

You’ll design rigorous evals, from LLM-as-a-judge to quasi-experimental methods, and translate complex measurement realities

Qualifications

  • Senior data scientist with internal-customer and/or platform measurement experience.
  • Experience designing evals for products where quality is hard to pin down.
  • Fluency with quasi-experimental and causal inference methods for when randomization isn’t possible.

Responsibilities

  • Define and operationalize the measurement strategy for the Connections Platform and the broader Data & Infrastructure Platform team.
  • Own the evaluation of CP’s LLM-based and agentic systems: design the evals and build the frameworks.
  • Own the causal inference and experimentation program for these teams: design and analyze A/B tests and quasi-experimental designs.
  • Translate complex measurement realities into clear narratives for VP and C-level partners.

Skills

Measurement experience
Data analysis
Python
SQL
Causal inference

Education

PhD and 4+ years in related field
MS and 6+ years in related field
BS and 8+ years in related field

Tools

LLM-as-a-judge

Job description

Zillow Group is seeking a Principal Data Scientist to be a measurement and impact partner in CoreTech. You will own four outcomes: quantify what shipped, what moved, and what didn’t; define metrics for CP and other platforms; build evaluation layers for LLM-based and agentic systems; and instrument these metrics with engineering across events, pipelines, and dashboards.

You’ll design rigorous evals, from LLM-as-a-judge to quasi-experimental methods, and translate complex measurement realities

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Principal Data Scientist — Platform Measurement & Impact
Remote Principal Data Scientist — Platform Measurement & Impact

Zillow • United States

Remote
USD 182,000 - 291,000
Remote position
Equity awards
Principal Platform Measurement Scientist
Principal Platform Measurement Scientist

Zillow Group • United States

Remote
USD 173,000 - 291,000
Equity awards
Principal Data Scientist
Principal Data Scientist

Zillow • United States

Remote
USD 182,000 - 291,000
Remote position
Equity awards
Principal Data Scientist
Principal Data Scientist

Zillow • United States

Remote
USD 173,000 - 291,000
Equity awards
Principal Data Scientist
Principal Data Scientist

ZINC Zillow, Inc. • United States

Remote
USD 173,000 - 291,000
Principal Data Scientist
Principal Data Scientist

Ladders • United States

Remote
USD 173,000 - 291,000
Remote work flexibility
Equity awards based on performance and
Executive-level exposure
+1
Lead Data Scientist, Rentals Shopping (Remote)
Lead Data Scientist, Rentals Shopping (Remote)

Archer • United States

Remote
USD 182,000 - 291,000
Remote work
Equity awards
Data Scientist, Partner Analytics (Remote)
Data Scientist, Partner Analytics (Remote)

Zillow Group Inc. • United States

Hybrid
USD 126,000 - 201,000
Equity awards
Remote work
Data Scientist, Partner Analytics — Remote ML
Data Scientist, Partner Analytics — Remote ML

Zillow Group Inc. • United States

Remote
USD 126,000 - 201,000
Senior Big Data Platform Engineer - Remote & AI-Driven
Senior Big Data Platform Engineer - Remote & AI-Driven

Archer • United States

Remote
USD 164,000 - 263,000