Director, Media Experimentation & Engagement — Scale Incremental Testing

SmartRecruiters, Inc.; California (MO); Hybrid; USD 135,000 - 180,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) plan

Tuition reimbursement

Job summary

NBCUniversal is seeking a Director, Media Experimentation & Engagement to lead the incrementality and engagement measurement program for Performance and Device media. You own the learning agenda, set rigor, and translate test results into clear budget guidance for leaders.

You will manage a team, partner with Growth Strategy and Decision Sciences, and drive measurement calibration across MMM and MTA, while scaling testing with AI-enabled analytics workflows in a hybrid work environment.

Qualifications

• 8+ years of experience in media measurement and analytics, including experience at measurement vendors or agencies, and including direct people management and a track record of building and developing teams
• 5+ years expertise in experimentation design and causal inference for media (structured testing, geo experiments, difference-in-differences, platform holdouts), with the ability to evaluate vendor assumptions and methods
• Fluent in SQL and Excel, and proficient in at least one of R or Python for data analysis

Responsibilities

• Own and scale the experimentation roadmap. Grow structured testing from roughly 15 to 75 panels per year while raising rigor on budget-grade decisions.
• Define and lead engagement measurement. Build NBCU’s forward approach to measuring media’s effect on subscriber engagement and retention.
• Own always-on holdouts. Lead holdout design and execution across Performance and Device media, including persistent engagement holdouts.
• Collaborate with Media Partners. Direct how NBCU uses conversion-lift programs and clean room environments for exposure mapping and lift measurement.
• Own measurement calibration. Serve as the source of truth for calibrating MMM and MTA, keeping media measurement consistent and decision-grade across the portfolio.
• Lead experimentation vendor relationships. Manage relationships across incrementality vendors, onboarding, data transfer, methodology validation, and ensuring deliverables.
• Represent the team at the executive level. Own measurement-methodology relationships with leadership and challenge entrenched beliefs.
• Build and develop the pod. Directly manage and develop a Manager and an Analyst, and level cross-functional partner teams.
• Drive AI-enabled scale. Use agentic AI and automated analytics workflows to expand testing throughput and decisioning.

Skills

Media measurement

Experimentation design

Executive presentation

Vendor management

Tools

SQL

Excel

R

Python

Job description

NBCUniversal is seeking a Director, Media Experimentation & Engagement to lead the incrementality and engagement measurement program for Performance and Device media. You own the learning agenda, set rigor, and translate test results into clear budget guidance for leaders.

You will manage a team, partner with Growth Strategy and Decision Sciences, and drive measurement calibration across MMM and MTA, while scaling testing with AI-enabled analytics workflows in a hybrid work environment.