Director, Experimentation, Decision Science New Raleigh, NC

MERGE; Raleigh, Northern (NC, KY); On-site; USD 114,000 - 145,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401K

Lifestyle Spending Account

Paid Time Off

Disability Insurance

Job summary

MERGE is seeking a Director of Experimentation, Decision Science to design and scale high-impact experimentation programs across web, digital, and media channels. You will act as a trusted advisor to clients, maturing testing capabilities, maximizing ROI, and delivering actionable customer insights to drive growth.

You will lead cross-functional teams, develop governance and roadmaps, and promote a data-driven, test-and-learn culture while partnering with engineering, analytics, and product

Qualifications

• Bachelor’s degree or equivalent practical experience in a relevant field.
• 5+ years of web, digital or media experimentation experience.
• Experience running A/B, multivariate, and personalization experiments across web, mobile, or digital platforms.
• Proven track record managing external client relationships and presenting to stakeholders.

Responsibilities

• Design cross-channel experimentation roadmaps and learning agendas aligned with client goals for web, app, and paid/owned media.
• Formulate data-driven hypotheses, define KPIs, audiences, and statistical parameters.
• Drive audience segmentation and personalization strategies to tailor user experiences.
• Oversee the complete experimentation workflow from ideation to post-launch QA.
• Collaborate with engineering, analytics, UX/UI, and media teams to validate tagging and tracking.

Skills

A/B Testing

Multivariate Testing

Personalization

Statistical Literacy

Client Relationships

Stakeholder Communication

Experimentation Roadmaps

Data Visualization

Education

Bachelor’s degree in Marketing, Business, Statistics, Psychology, Human Factors, or equivalent practical experience

Tools

Adobe Target

Job description

At MERGE, we are Built Different. We are a marketing and technology agency purpose-built for the intersection of health and wellness—where human impact matters most. By weaving storytelling through technology, we move beyond traditional engagement to Whole Human Marketing. This approach recognizes that humans are multidimensional and complex, and uses AI to ensure every brand interaction feels natural, contextual, and relevant.

This commitment to human-first innovation is what brings us together and propels us forward. We are united by our North Star: to unite people and brands to empower healthier, happier lives.

Emerge to the Top of Your Career

At MERGE, we strive to create a superior work experience where talented and ambitious people grow. An experience that encourages people to think higher and feel deeper. An experience where people engage their minds and hearts to do the best work of their careers.

As our Director, Experimentation, Decision Science, you will…

Play a pivotal role on our consulting team, working directly with clients to design, manage, and scale high-impact experimentation and personalization programs. Serving as a trusted advisor across web, digital, and media channels, you will consult on scaling client experimentation programs and drive hands‑on program execution. In this role, you will mature client testing capabilities, maximize ROI, and unlock deeper customer insights to drive business growth.

What You’ll Do

• Design comprehensive cross-channel experimentation roadmaps and learning agendas aligned with client business goals across web, app, and paid/owned media channels
• Formulate data-driven hypotheses, determine experiment feasibility, and define primary/secondary KPIs, target audiences, and statistical parameters (sample size, experiment duration, confidence intervals)
• Drive audience segmentation and personalization strategies to deliver tailored user experiences across key digital touchpoints
• Oversee and facilitate the complete experimentation workflow—from ideation, targeting setup, and variant build specs to post-launch quality assurance
• Collaborate closely with engineering, analytics, UX/UI, and media teams to validate tag implementation, audience integration, and parameter tracking prior to test launches.
• Monitor live test health, audience distribution, and data integrity to troubleshoot mid-flight anomalies or tracking issues
• Evaluate multivariate, A/B, and personalization experiment results, translating complex outputs into compelling, executive-ready stories and strategic next steps
• Work with analysts to quantify conversion lift, financial impact, and projected annual ROI to clearly demonstrate program value to senior executives
• Act as a strategic consultant to assess client experimentation programs, benchmark maturity against industry standards, and deliver action plans to elevate client capabilities
• Advise client stakeholders throughout the experimentation lifecycle, establishing governance, standardized documentation, intake processes, and prioritization frameworks
• Advise and support clients throughout the experimentation execution process by sharing expert experimentation guidance and best practices with all client-side stakeholders
• Promote a continuous "test-and-learn" culture by facilitating cross-functional insights-sharing forums and training sessions
• Upskill client and internal agency teams on experimentation best practices, statistical literacy, and testing tool capabilities
• Cross-pollinate winning experiment concepts across different media formats, site sections, and client portfolios to maximize output efficiency

What You’ll Bring

• Bachelor’s degree in Marketing, Business, Statistics, Psychology, Human Factors, or equivalent practical experience
• 5+ years of web, digital or media experimentation experience
• Direct experience running A/B, multivariate, and personalization experimentation programs across web, mobile, or digital media platforms
• Proven track record of managing external client relationships, presenting to key stakeholders, and navigating matrixed organizations
• Demonstrated history of partnering closely with engineering, UX/UI, analytics, and product teams to execute technical projects
• Ability to manage multiple client accounts and concurrent test roadmaps independently under tight deadlines
• Hands‑on experience with Adobe Target. Experience with other experimentation and personalization platforms a plus
• Practical knowledge of end-to-end site optimization, multivariate testing, A/B testing, and user segmentation/personalization
• Foundational knowledge of statistical concepts relevant to testing
• Ability to benchmark client testing maturity, build strategic roadmaps, and align testing initiatives with overarching business goals
• Ability to assist with RFPs, contract renewals, client upsells, and identifying new strategic service opportunities
• Strong organizational ability to manage multiple concurrent testing projects, establish governance, and standardize intake/prioritization processes with minimal supervision
• Exemplary written and verbal communication skills to translate complex data into concise, digestible, and executive-ready recommendations
• Ability to form partnerships with various client-side and agency-side stakeholders
• A self‑starter mindset with strong problem‑solving skills, high attention to detail, and a desire to continuously learn and share industry trends
• Travel up to 30% (ability and need to travel depends on client needs)

#LI-NT1

#LI-HYBRID

At MERGE, we’re committed to fostering an environment where our team members can thrive in both their careers and personal lives, ensuring they feel supported and empowered to succeed.

MERGE believes in transparency and equity. In accordance with state regulations, we’re proud to include salary ranges in our job postings to ensure fair compensation practices.

The salary range for this role is $114,400 - $145,000, based on the individual’s skills, experience, qualifications, location, and other relevant factors. The salary pay range is subject to change and may be modified at any time.

MERGE is proud to invest in benefits that includemeaningful Medical, Dental, Vision, Life Insurance, 401K, Lifestyle Spending Account, Employer Paid Life & Disability Insurance, Flexible Time off & Holidays plus many other benefits and rewards.

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.

And here’s how we live our values at MERGE

• Ability. Mastering our craft
• Agility. Delivering with a growth mindset
• Humility. Collaborating for shared success

MERGE is proud to be an Equal Opportunity Employer

MERGE welcomes and celebrates diversity regardless of race, religion, color, national origin, gender, sexual orientation, veteran status or people with abilities. We believe that the more diverse we are, the more creative our work will be!