Director, Media Experimentation & Engagement

SmartRecruiters, Inc.; California (MO); Hybrid; USD 135,000 - 180,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) plan

Tuition reimbursement

Job summary

NBCUniversal is seeking a Director, Media Experimentation & Engagement to lead the incrementality and engagement measurement program for Performance and Device media. You own the learning agenda, set rigor, and translate test results into clear budget guidance for leaders.

You will manage a team, partner with Growth Strategy and Decision Sciences, and drive measurement calibration across MMM and MTA, while scaling testing with AI-enabled analytics workflows in a hybrid work environment.

Qualifications

• 8+ years of experience in media measurement and analytics, including experience at measurement vendors or agencies, and including direct people management and a track record of building and developing teams
• 5+ years expertise in experimentation design and causal inference for media (structured testing, geo experiments, difference-in-differences, platform holdouts), with the ability to evaluate vendor assumptions and methods
• Fluent in SQL and Excel, and proficient in at least one of R or Python for data analysis

Responsibilities

• Own and scale the experimentation roadmap. Grow structured testing from roughly 15 to 75 panels per year while raising rigor on budget-grade decisions.
• Define and lead engagement measurement. Build NBCU’s forward approach to measuring media’s effect on subscriber engagement and retention.
• Own always-on holdouts. Lead holdout design and execution across Performance and Device media, including persistent engagement holdouts.
• Collaborate with Media Partners. Direct how NBCU uses conversion-lift programs and clean room environments for exposure mapping and lift measurement.
• Own measurement calibration. Serve as the source of truth for calibrating MMM and MTA, keeping media measurement consistent and decision-grade across the portfolio.
• Lead experimentation vendor relationships. Manage relationships across incrementality vendors, onboarding, data transfer, methodology validation, and ensuring deliverables.
• Represent the team at the executive level. Own measurement-methodology relationships with leadership and challenge entrenched beliefs.
• Build and develop the pod. Directly manage and develop a Manager and an Analyst, and level cross-functional partner teams.
• Drive AI-enabled scale. Use agentic AI and automated analytics workflows to expand testing throughput and decisioning.

Skills

Media measurement

Experimentation design

Executive presentation

Vendor management

Tools

SQL

Excel

R

Python

Job description

• Full-time
• Business Segment: Media Group Functions
• Compensation: USD 135,000 - USD 180,000 - yearly

Company Description

NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our global theme park destinations, consumer products, and experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, NBC Sports, Telemundo, NBC Local Stations, Bravo, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through our powerhouse film and television studios, including Universal Pictures, DreamWorks Animation, and Focus Features, and the four global television studios under the Universal Studio Group banner, and operate industry-leading theme parks and experiences around the world through Universal Destinations & Experiences, including Universal Orlando Resort, home to Universal Epic Universe, and Universal Studios Hollywood. NBCUniversal is a subsidiary of Comcast Corporation. Visit www.nbcuniversal.com for more information.

Our impact is rooted in improving the communities where our employees, customers, and audiences live and work. We have a rich tradition of giving back and ensuring our employees have the opportunity to serve their communities. We champion an inclusive culture and strive to attract and develop a talented workforce to create and deliver a wide range of content reflecting our world.

Job Description

The Director, Media Experimentation & Engagement leads NBCU’s incrementality and engagement measurement program for Performance and Device media. Experimentation is the causal calibration source for Growth Media Analytics’ measurement triangle: the function that keeps Marketing Mix Modeling (MMM) and Multi-Touch Attribution (MTA) decision-grade. You own the learning agenda, set the standard for rigor, and translate test results into clear budget guidance leaders can act on with speed and confidence.You define how NBCU measures media’s effect on subscribervalueandengagement,a criticalcausal measurementpracticeforthebusiness. Youmanage a team tohigh-quality execution and train the next set of analytic leaders, and you are the face of Growth Media Analytics to Performance Media, Device Media, Growth Strategy, and Decision Sciences leadership on experimentationmethodology.

Key Responsibilities

• Own and scale the experimentation roadmap.Grow structured testing fromroughly 15to 75 panels per year while raising rigor on budget-grade decisions. Define the learning agenda, decision questions, hypotheses, success metrics, guardrails, and power thresholds, and approve or reject vendor designs against those standards.
• Define and lead engagementmeasurement.Build NBCU’s forward approach to measuring media’s effect on subscriber engagement and retention, in partnership with Growth Strategy and Decision Sciences.This includes variance reduction techniques for low-signal continuous outcomes, and the translation from measured lift to revenue andretention value.
• Own always-on holdouts.Lead holdout design and execution across Performance and Device media, including persistent engagement holdouts.
• Collaboratewith Media Partners.Direct how NBCU usesconversion-lift(CLS)programs andclean room environments (Meta Advanced Analytics, Google ADH, Amazon AMC) for exposure mapping and liftmeasurement andset the standard for whatpartnerscan and cannot answer.
• Own measurement calibration.Serve as the source of truth for calibrating MMM and MTA, keeping media measurement consistent and decision-grade across the portfolio.
• Leadexperimentationvendorrelationships.Manage relationships across incrementality vendors,includingnew vendor onboarding,datatransfer,validatingmethodologyandresult, andensuringcriticaldeliverables areshared tothe business.
• Represent the team at the executive level.Own measurement-methodology relationships with Performance Media and Device Media leadership, Growth Strategy, Finance, and Decision Sciences. Challenge entrenched measurement beliefs and drive adoption of decision-grade testing.
• Build and develop the pod.Directly manage and develop aManagerand anAnalyst, anduplevelcross-functionalpartner teams on test design, statistical power, and common pitfalls.
• Drive AI-enabled scale.Use agentic AI and automated analytics workflows to expand testing throughput, insight generation, and decisioning.

Qualifications

• 8+ years of relevant experience in media measurement and analytics, including experience at measurement vendors or agencies, and including direct people management and a track record of building and developing teams
• 5+ years expertise in experimentation design and causal inference for media (structured testing, geo experiments, difference-in-differences, platform holdouts), with the ability to evaluate vendor assumptions and methods.
• Strong foundation across the measurement triangle of MMM, MTA, and experimentation, with proven ability to reconcile and calibrate across them and translate results into business decisions.
• Fluent in SQL and Excel, and proficient in at least one of R or Python for data analysis.

Desired Characteristics

• Demonstrated experience presenting insights to executive audiences, with ability to create process/governance and ability to answer difficult questions in high pressure situations.
• 2+ years of experience partnering with (or working at) incrementality measurement vendors (e.g., Haus, Measured, or similar) and managing media, agency, and vendor relationships.
• Platform experience across Google, Meta, and TikTok incrementality, and at least one CTV or Device environment (e.g., Roku, Samsung, Vizio).
• Working knowledge of clean room environments, with a clear point of view on where they produce decision-grade evidence and where they do not.
• Demonstrated ability to measure and optimize multiple KPIs, including acquisition, engagement, and performance outcomes.
• Experience leveraging, or strong interest in adopting, agentic AI and automated analytics workflows to scale experimentation and decisioning.
• Excellent communication skills and executive presence, with the ability to influence in a highly matrixed environment.
• Strong interest in the media industry, specifically television and streaming.
• Strong sense of accountability, curiosity, and an innovative mindset, with the ability to thrive in a fast-paced, evolving environment.

Additional Requirements

• Hybrid:This position currently has a hybrid schedule, which requires contributing from the office a minimum of four days per week. The Company reserves the right to change in-office requirements at any time.
• This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website. Salary range: $135,000 - $180,000 (bonus and long-term incentive eligible).
  

Additional Information

As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.

NBCUniversal will consider for employment qualified applicants with criminal histories, or arrest or conviction records, in a manner consistent with relevant legal requirements, including the City of Los Angeles' Fair Chance Initiative For Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, where applicable.

If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to [e-mail].