Manager, Media Experimentation & Incrementality

NBC Universal; New York (NY); Hybrid; USD 100,000 - 160,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k)

Paid leave

Tuition reimbursement

Job summary

NBCUniversal is implementing a strategic evolution in measurement with a focus on causal analytics across Performance and Device media. The Manager, Media Experimentation & Incrementality leads the design, execution, and quality of NBCU's incrementality studies to drive subscriber growth and validate media impact.

Based in a hybrid environment, you will own study design, power analysis, vendor validation, and collaboration with Marketing Analytics to align on decisions and pacing across the

Qualifications

• 4+ years in marketing/media experimentation with design/QA ownership.
• Experience partnering with an incrementality testing measurement vendor.
• Fluent in SQL and Excel for validation and reporting.
• Knowledge of power analysis and common failure modes.

Responsibilities

• Review study designs for statistical rigor and power.
• Define hypotheses and end-to-end execution of testing roadmap.
• Validate vendor methods with targeted SQL, R, or Python analyses.
• Calibrate results across MMM and MTA with cross-method alignment.
• Manage backlog and vendor relationships for timely studies.
• Produce clear readouts and memos for decision making.
• Mentor junior analysts on test design and power concepts.

Skills

SQL

Excel

R

Python

Causal inference

Power analysis

Vendor management

Statistical analysis

Tools

Haus

Measured

Job description

• Full-time
• Business Segment: Media Group Functions
• Compensation: USD 100,000 - USD 160,000 - yearly

Company Description

NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our global theme park destinations, consumer products, and experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, NBC Sports, Telemundo, NBC Local Stations, Bravo, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through our powerhouse film and television studios, including Universal Pictures, DreamWorks Animation, and Focus Features, and the four global television studios under the Universal Studio Group banner, and operate industry-leading theme parks and experiences around the world through Universal Destinations & Experiences, including Universal Orlando Resort, home to Universal Epic Universe, and Universal Studios Hollywood. NBCUniversal is a subsidiary of Comcast Corporation. Visit www.nbcuniversal.com for more information.

Our impact is rooted in improving the communities where our employees, customers, and audiences live and work. We have a rich tradition of giving back and ensuring our employees have the opportunity to serve their communities. We champion an inclusive culture and strive to attract and develop a talented workforce to create and deliver a wide range of content reflecting our world.

Job Description

Peacock is in the middle of a significant strategic evolution, and how we measure media sits at the center of it. Our investment spans major performance publishers and leading streaming and CTV device platforms and proving the true incremental impact of that investment is one of the most consequential analytics problems in the business. The Manager, Media Experimentation & Incrementality is responsible for the design, execution, and quality of NBCU's incrementality testing program: the studies that establish what media actually drives subscriber growth.

Sitting within the Media Analytics team, this role helps shape the learning agenda for testing across Performance and Device media and owns how each study is designed, run, and read: decision-grade standards, defensible results, and clear budget guidance. Experimentation is one of three pillars in our measurement framework, alongside Marketing Mix Modeling and Multi-Touch Attribution, and serves as the causal source of truth that calibrates the other two.

This is a technical role first. The program is expanding in scope and rigor, including extending causal measurement beyond acquisition into subscriber engagement, and its credibility rests on the quality of its methods. The ideal candidate has deep command of causal inference in media (RCTs, geo and matched-market designs, difference-in-differences, holdouts), fluency in power analysis and common failure modes such as leakage and seasonality, and the hands-on SQL, R, or Python skills to independently validate what vendors deliver. Strong communication and cross-functional influence remain essential; here, they are built on technical credibility.

Key Responsibilities

Responsibilities include, but are not limited to:

• Own statistical rigor across the program: review and approve study designs, evaluate vendor methods and assumptions, enforce power standards, and reject or redesign under-powered or invalid proposals
• Shape the incrementality testing roadmap with Media Analytics leadership: define hypotheses, decision criteria, and power thresholds, and own end-to-end execution of the roadmap
• Run independent validations: monitor for leakage, seasonality confounds, and design defects, and pressure-test vendor deliverables with targeted SQL, R, or Python analysis
• Triangulate experiment results with MMM and MTA: drive calibration across methods, propose tiebreakers where results diverge, and contribute to a unified view of incrementality across the measurement portfolio
• Manage the day-to-day relationship with our experimentation vendor: prioritize the study backlog, align on methodology, maintain testing schedules, and elevate blockers early
• Produce clear, defensible readouts: quantify lift and uncertainty, write concise decision memos, and hand off guidance to the Optimization & Insights team for in-market execution and pacing
• Support the expansion of causal measurement into subscriber engagement, including holdout-based approaches
• Mentor a Media Analytics analyst and uplevel partner teams on test design, statistical power, and common pitfalls, contributing to a standardized measurement approach across NBCU's Media Group

Qualifications

• 4+ years in marketing/media experimentation with direct design/QA ownership and experience partnering with an incrementality testing measurement vendor (e.g., Haus, Measured, or similar).
• Proven command of causal inference in media—appropriate use of RCT, geo, diff-in-diff, and platform holdouts—and the ability to evaluate vendor assumptions/methods.
• Familiarity with power analysis, and failure modes (leakage, seasonality, parallel trends); history of stopping or redesigning under-powered tests.
• Platform experience: Google/Meta/TikTok incrementality and at least one CTV/Device environment (e.g., Roku, Samsung, Vizio).
• Experience reconciling vendor experiment reads with MMM/MTA and informing planning/pacing decisions without surprises.
• Fluent in SQL and Excel
• Knowledge of big data infrastructure and data science techniques.
• Effective communicator and collaborator with strong project management; ability to work in a highly matrixed environment and influence media buyers/channel leads.

Desired Characteristics:

• Strong interpersonal skills with the ability to collaborate, motivate, and influence.
• Ability to thrive in a fast-paced environment and meet tight deadlines.
• Proficient in using R or Python for data analysis
• Strong interest in the media industry, specifically in television and streaming.
• Strong sense of accountability, curiosity, and an innovative mindset, with the ability to thrive in a fast-paced, evolving environment.

Additional Requirements:

• Hybrid: This position has been designated as hybrid, which currently requires contributing from the office a minimum of three days per week. Beginning January 5, 2026, hybrid employees will be required to work from the office a minimum of four days per week. The Company reserves the right to change in-office requirements at any time.
• This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website. Salary range: $100,000 - $160,000 (bonus & long-term incentive eligible).

Additional Information

As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.

If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to [e-mail].

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply