Lead AI Product Data Scientist, Agents

Klaviyo; Boston (MA); On-site; USD 172,000 - 258,000; Full time

Job summary

Klaviyo seeks a Lead Product Data Scientist, Agents to own measurement and data science strategy for Composer and Customer Agent, combining deep technical expertise with strong product judgment to influence AI investments.

This highly visible, hands-on role defines analytics foundations, evaluates agent performance, and translates insights into actionable recommendations across product, pricing, and strategy. You’ll mentor data scientists and shape the technical direction of agent analytics.

Qualifications

• 10+ years of experience in data science, product analytics, applied statistics, or related field.
• Experience measuring AI, ML, or LLM-powered products in production.
• Proficiency in SQL and Python or R; familiarity with dbt and analytics engineering practices.

Responsibilities

• Own agent measurement end-to-end across Composer and Customer Agent.
• Define meaningful measures of agent effectiveness, engagement, and business value.
• Build scalable evaluation frameworks using data, traces, and human labeling.

Skills

Measurement

Experimentation

Statistical modeling

Causal inference

SQL

Python

Education

Statistics or related quantitative degree

Tools

dbt

Python

R

Job description

Klaviyo seeks a Lead Product Data Scientist, Agents to own measurement and data science strategy for Composer and Customer Agent, combining deep technical expertise with strong product judgment to influence AI investments.

This highly visible, hands-on role defines analytics foundations, evaluates agent performance, and translates insights into actionable recommendations across product, pricing, and strategy. You’ll mentor data scientists and shape the technical direction of agent analytics.