Experimentation & CRO Analyst

Groupe Dynamite Inc.; Mount Royal; On-site; CAD 90,000 - 130,000; Full time

Benefits offered by this job

Performance bonuses

Group retirement savings with employer

Flexible vacation policy

Employee discount at Garage and Dynamï

Exclusive private sample sales

Job summary

Groupe Dynamite Inc. is seeking an experienced experimentation professional to drive A/B testing and personalization across web and app for GARAGE and DYNAMITE.

You will manage the end-to-end roadmap, translate insights into revenue impact, and collaborate with product, design, and analytics teams. You will set up experiments in Optimizely, validate results with rigorous statistics, and champion CRO best practices across channels.

Qualifications

• 3–4 years hands-on A/B testing and CRO experience in an e-commerce or digital product environment.
• Strong statistical foundation: understand p-values, confidence intervals, sample size, statistical power, and multiple testing risks.
• Experience with Optimizely.
• Experience writing Jira tickets with clear hypotheses, metrics, and acceptance criteria.
• Proven ability to own a roadmap and drive it forward independently.

Responsibilities

• Own the end-to-end experimentation roadmap for web and app across both brands, prioritizing tests with a structured scoring framework.
• Develop data-driven hypotheses from UX research, session recordings, and funnel analytics, and translate into test briefs with metrics and acceptance criteria.
• Set up, QA, and launch experiments in SiteSpect and Optimizely, coordinating with product, design, development, and QA.
• Monitor live tests, analyze results with statistical rigour, and present findings through documentation and decks.
• Lead stakeholder communication including monthly roadmap alignment meetings and status updates.
• Identify personalization opportunities and champion CRO/UX best practices for permanent rollout.

Skills

A/B testing

CRO strategy

Statistical analysis

Optimizely

GA4

Jira

Education

Bachelor's degree in Statistics/Mathematics/CS/Engineering

Tools

Optimizely

GA4

Jira

Dynamic Yield

Klaviyo

Nosto

Job description

Overview

Groupe Dynamite is a leading fashion digital retailer with two brands at the heart of our success, GARAGE and DYNAMITE. With over 300 stores in Canada and the U.S., and more than 4,000 people, we have been making our mark on fashion since 1975. Our core strengths are rooted in our team, our innovation, and our customers. We are proud to hire and retain aspirational leaders who are driven to achieve great things and recognized for their entrepreneurial spirit.

Job Summary:

Reporting to the Manager, E-comm Analytics and Experimentation, you will be the engine behind our A/B testing and personalization program across web and app for both the GARAGE and DYNAMITE brands. You will own the experimentation roadmap end to end—from generating creative ideas and insight-led hypotheses to launching live tests, reading results with statistical rigour, and translating wins into measurable revenue impact.You will be responsible for defining test strategy, setting up and running experiments in SiteSpect and Optimizely, coordinating across product, design, development, and QA teams, and maintaining a high standard of statistical discipline across all test conclusions. In this role, you will partner closely with the Web, App, Paid Media, CRM, E-comm, and Analytics teams across both brands.

Main Responsibilities:

• Own the end-to-end experimentation roadmap for web and app across both brands, prioritizing tests with a structured scoring framework aligned to quarterly conversion and revenue goals.
• Develop data-driven hypotheses from UX research, session recordings, and funnel analytics, and translate them into detailed test briefs (Jira tickets) with clear metrics, audience segments, and acceptance criteria.
• Set up, QA, and launch experiments in SiteSpect and Optimizely, coordinating with product, design, development, and QA through staging, UAT sign-off, and go-live.
• Monitor live tests, analyze results with statistical rigour (significance, confidence intervals, segment breakdowns), and present findings through results documentation, decks, and video walkthroughs.
• Lead stakeholder communication, including monthly roadmap alignment meetings, keeping teams proactively informed of test status, results, and next steps.
• Identify personalization opportunities across the funnel and champion CRO/UX best practices as the team's subject matter expert, recommending winning variants for permanent rollout.

Qualifications:

• Degree in a quantitative field such as Statistics, Mathematics, Computer Science, Data Science, or Engineering;
• 3 to 4 years of hands‑on A/B testing and CRO experience in an E-commerce or digital product environment, with a clear track record of driving measurable conversion impact;
• Strong statistical foundation: you understand p-values, confidence intervals, sample size calculation, statistical power, and the risks of peeking and multiple testing—and you apply this rigour consistently;
• Hands‑on experience with Optimizely;
• Experience writing Jira tickets that developers, QA, and stakeholders can easily execute—including clear hypothesis, defined metrics, precise acceptance criteria;
• Proven ability to own a roadmap and drive it forward independently without day‑to‑day direction;
• Strong communicator able to translate statistical concepts into clear business language for non‑technical audiences;
• Experience with GA4 or equivalent analytics platforms for funnel analysis and test monitoring.

Assets:

• Familiarity with mobile app testing environments and the constraints of in‑app experimentation;
• Experience with personalization tools such as Dynamic Yield, Nosto, or Klaviyo segmentation;
• Ability to create Figma mockups or wireframes to accompany test briefs.

At GDI, you will be part of a growing organization that understands the importance of investing in people and offers you:

• A comprehensive compensation package that includes performance‑driven bonuses;
• A group retirement savings program with employer matching;
• Flexible group insurance with personalized coverage that meets your needs;
• An employee discount at Garage and Dynamite;
• Exclusive private sample sales;
• A flexible vacation policy;
• And more!

GDI has been repeatedly voted one of Montréal’s Top Employers and one of Canada’s Top Employers for Young People.

Our promise…No day will be like the last—we aim to be better today than we were yesterday. We are committed to employment equity.

Candidates that are retained will be called for an interview.#NR-LI1